Welcome to CGMB574 Virtual Reality

1. Computer Graphics and Multimedia Department Welcome toCGMB574 Virtual Reality

2. Textbook: Burdea and Coiffet, Virtual Reality Technology, 2nd Edition, Wiley, 2003

3. Textbook web site: www.vrtechnology.org

4. Textbook web site: www.vrtechnology.org

5. Introduction

6. What is VR….? • Let’s describe in term of functionality • It’s a simulation • Not static - interactive • Real-time - User become captivated • Interactivity + captivating power = immersion • VR push further – all human sensorial channel

7. Introduction What is Virtual Reality? “A high-end user-computer interface that involves real-time simulation and interaction through multiple sensorial channels.” (vision, sound, touch, smell, taste)”

8. What is Virtual Reality? (cont) “a medium composed of interactive computer simulations that sense the participant’s position and actions and replace or augment the feedback to one or more senses, giving the feeling of being mentally immersed or present in the simulation (a virtual world)”

9. Related Terms Artificial Reality (coined by Myron Krueger, 1991) an artifical reality perceives a participant’s action in terms of the body’s relationship to a graphic world and generated responses that maintain the illusion that his or her actions are taking place within that world Virtual Environment 1. a virtual world. 2. an instance of a virtual world presented in an interactive medium such as virtual reality

10. Related Terms Cyberspace (coined by William Gibson, 1984 a location that exists only in the minds of the participants, often as a result of technology that enables geographically distant people to interactively communicate Augmented Reality a type of virtual reality in which synthetic stimuli are registered with and superimposed on real-world objects; often used to make information otherwise imperceptible to human senses perceptible

11. Related Terms Telepresence the ability to directly interact (often via computer mediation) with a physically real, remote environment from the first-person point of view; there are no restrictions on the location of the remote environment, and there are no restrictions on the size of the device used to carry out the user’s commands at the remote location

12. Introduction VR is an integrated trio of “Immersion”, “Interaction” and “Imagination”

13. Introduction VR equation Reality Simulator / Reality Engine Virtual Reality Effectors • Tracker – that monitor the user movement • Virtual visualization– that let the user see what is happening • 3D sound– that let the user hear what is happening • Touching /Manipulation devices– that let user feel the objects and manipulate it in virtual environment • Computers that processing the simulation/environment • Generate and draw or render highly detailed images of virtual environment • Blending 3D sound effect • Calculate any touch related, or tactile, effects present in the virtual environment • Rapidly change how the environment looks • Behave in the response to the user’s action • It have to be powerful to create even simple virtual environment

17. Introduction Sensorama Simulator, US Patent #3,050,870, 1962

18. Introduction NASA VIEW system (1989)

19. Introduction NASA VIEW system (1992)

20. Components of Virtual Environment (VE) • Immersion • Feeling of being inside and part of the virtual world • Type of immersion • Mental immersion – state of being deeply engaged, suspension of disbelief • Physical immersion – synthetic stimulus of the body’s senses via the use of technology  this does not imply all senses or the entire body is immerged/engulfed • Interaction • The ability to interact in VE • Need to have virtual body (i.e. virtual hand to simulate the touching and manipulating the virtual object) • Tactile feedback • The ability to touch and feel virtual object • Acoustic feedback • Adding sound in VE • This feedback complement the interactive and tactile domain

21. Type of VR system • Immersive • Computer generated images will replace the real world view • The generated images will react to the position and orientation of the user’s head • Non-Immersive • Users are able to view the virtual world however, they are still aware of the real world • i.e. viewing the VE through a monitor • Hybrid • Permits the user to view the real world with virtual images superimposed over this view • Also known as augmented reality

22. Augmented Reality (AR) • It is a technology related to VR that uses many of the same tools of VR • It differs from VR, in that AR enhances rather than replaces, one’s view of the physical world • A typical AR system features transparent optics that reflect computer-generated images into the user’s eye • This create an images appear to overlay real objects in front of the user • It is a potential benefits to physicians, engineers, and other professionals

23. Augmented Reality (AR) • Augmented Reality should consists of • Combines real and virtual. • Is interactive in real-time. • Is registered in 3D. • Relies on accurate 3D graphics • I.e. Fighter pilot • View outside world simultaneously with everything that should appear in real world • Targets, boundaries and landmarks are clearly shown • I.e. Medicine • Using virtual environment to simulate operation process

24. Application of VR • Altering virtual office building • Detecting design flaws with VR • Escape disaster with VR design • Getting a feel for microscopic worlds • Exploring other planets via VR • VR and scientific visualization • Creating better construction equipment with VR • Medical training with VR • Physical therapy in Virtual World • Fighting phobias in a safe environment • Changing store layout via VR • Shopping for a house with VR • High-tech training in Virtual Environment • VR and entertainment and gaming • Military training with VR

25. The key elements of a VR System