1 / 14

A haptic presentation of 3D objects in virtual reality for the visually disabled

A haptic presentation of 3D objects in virtual reality for the visually disabled. MSc Marcin Morański Professor Andrzej Materka Institute of Electronics, Technical University of Lodz, Poland www.eletel.eu . Plan of the presentation. Aim of the project Background

rozene
Download Presentation

A haptic presentation of 3D objects in virtual reality for the visually disabled

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. A haptic presentation of 3D objects in virtual reality for the visually disabled MScMarcinMorański Professor AndrzejMaterka Institute of Electronics, Technical University of Lodz, Poland www.eletel.eu

  2. Plan of the presentation • Aim of theproject • Background • A haptic presentation system • The system working principle • Experiments with blind users • Conclusions ICDVRAT 2012: A haptic presentation of 3D objects in virtual reality for the visually disabled

  3. Aim oftheproject Goals: • to construct a prototype system for the tactile presentation of real objects in a virtual reality; • to check the opportunity of the application of the tactile presentation system for the blind and visually impaired; • to examine the usability and potential of the force feedback device, Falcon Novint, for a 3D virtual object presentation without the usage of vision. Assumptions: The prototypesystem should integrate adepth cameraand a haptic device. ICDVRAT 2012: A haptic presentation of 3D objects in virtual reality for the visually disabled

  4. Background Source: http://www.niewidomi.com.pl ICDVRAT 2012: A haptic presentation of 3D objects in virtual reality for the visually disabled

  5. A haptic presentation system The block diagram of the prototype ICDVRAT 2012: A haptic presentation of 3D objects in virtual reality for the visually disabled

  6. The system working principle ICDVRAT 2012: A haptic presentation of 3D objects in virtual reality for the visually disabled

  7. Virtual scene modeling a) b) c) a) 2.5D depth map of the scene, b) the segmented scene, c) the reconstructed scene for the tactile presentation. ICDVRAT 2012: A haptic presentation of 3D objects in virtual reality for the visually disabled

  8. Experiments (1) Participants: • 8 blind persons(2 women and 6 men). Setup: • the objects in each scene were located on the ground, against a background; • an exploration time of every scene was measured; • the task was carried out successfully when the blind person correctly identified all obstacles in the presented scene. a) b) a) An example of the scene, b) theexperimental setup ICDVRAT 2012: A haptic presentation of 3D objects in virtual reality for the visually disabled

  9. Experiments (2) The experiments were divided into 4 stages: 1.Training phase; 2. Scene content recognition; 3. Distance estimation to each obstacle from a chosen point of observation; 4. Estimation of obstacles’ height. ICDVRAT 2012: A haptic presentation of 3D objects in virtual reality for the visually disabled

  10. Summary of experimentresults ICDVRAT 2012: A haptic presentation of 3D objects in virtual reality for the visually disabled

  11. Comments and suggestions of the blind participants • a special focus is required when creating small objects and scene • containing many details; • adding vocal information about the 3D position of the probe (the virtual • finger in the system) • the sonification of the some of the scene points or objectswould also be • very useful • there are a couple of potential application when such a system • could help the blind in everyday activities. ICDVRAT 2012: A haptic presentation of 3D objects in virtual reality for the visually disabled

  12. Experimentconclusions • The performed experiments have shown that the system can be useful for the blind, although there are still some challenges to overcome. Manyrequirements need to be met, mainly: • choosing the scale of virtual objects in the ratio to the real ones; • solving the problem of losing oneself in VR; • solving the problem of presenting scenes consisting of many objects/details (each of a different size), as the system’s resolution is finite. ICDVRAT 2012: A haptic presentation of 3D objects in virtual reality for the visually disabled

  13. Conclusions • A prototype system for tactile presentation of real objects in a virtually reality was presented. • The system usability was examined by the blind participants. • The designed system have potential to be a very useful tool for visually disabled in many applications, such as building virtual maps and creating simulators where real objects are presented virtually. ICDVRAT 2012: A haptic presentation of 3D objects in virtual reality for the visually disabled

  14. Acknowledgements This work has been supported by the Ministry of Science and Higher Education of Poland research grant no. NR02008310 in years 2010 - 2013.The presentedstudy is carriedout with cooperation with Lodz Chapter of the Polish Society for the Blind. ICDVRAT 2012: A haptic presentation of 3D objects in virtual reality for the visually disabled

More Related