1 / 18

ASM Mahfujur Rahman

ASM Mahfujur Rahman. Bridging Virtual to Real: A New Approach to Annotation, 2D/3D Representation and Interaction with Ambient Environment. Agendas. Introduction Motivation Physical browsing Related works POLE framework Milestones. Introduction.

ken
Download Presentation

ASM Mahfujur Rahman

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ASM Mahfujur Rahman Bridging Virtual to Real: A New Approach to Annotation, 2D/3D Representation and Interaction with Ambient Environment

  2. Agendas • Introduction • Motivation • Physical browsing • Related works • POLE framework • Milestones

  3. Introduction • Lack of interaction with the physical objects • New advancement in ambient intelligence and natural interaction techniques • Making crossing the border between virtual and real world natural and even invisible to the user • Possibilities of new applications that combines interactions from both virtual and real world

  4. Interaction with physical objects • Museum experience • Lack of interaction with the displayed object • Edutainment • The interactive game based learning • Instills entertainment and assists in the learning process ]a ]b

  5. Physical browsing (cont) + = User interacting with the real object Locate the annotated information at the tangible device position and augment associated information in the output video

  6. Related works: Collect and Drop [Broll 2008]

  7. Related works: P2D Mobile Interaction [Froehlich 2008]

  8. Related Works: Pull Me [Hinske 2007]

  9. Related works: Poster Interaction [Ruzkio 2007]

  10. Limitations in the existing works • Annotation process • RFID, Visual based tags: not intuitive, limited distance and performance trade offs • Using existing maps: not usable in indoor locations and where unavailable • Position determination • GPS: not available in indoor locations • Interaction mechanism • Pull-me, collect and drop, touch etc.: Lacks natural interaction capabilities • Content delivery • Mobile phone

  11. Solution: POint to Learn (POLE) framework • Annotation process • Everything could be an information tag [rahman, vecims et al 2009] • Position determination • IR based position determination • Interaction mechanism • Point and touch: with hands or mobile devices [rahman et al, acmm, 2009] • Content delivery • Mobile phones, laptops, computers

  12. Research milestones • Real to virtual interaction • Annotation scheme: almost complete • 2D position determination is working: complete • Mobile phone to access content: incomplete • Mobile phone to point to content: will work • Hand to point to physical object: almost complete • Haptic feedback: will work • Virtual to real interaction • 3D environment construction: work in progress • Virtual interaction: will work, need more inputs • Creating link between virtual and real world services and interactions: working

  13. Gesture based interaction with physical objects

  14. Gesture based interaction with ambient media

  15. Multi modal interaction with annotated media

  16. Applications In Museum to know more about civilization, animals, fossils, space ships (a mockup for each of these needed to enhance the interaction that are mostly available in the museums) Teaching the younger about a complex subject and gain their attention (the map example) Medical sciences: Learning the operations of scientific apparatus/substances (amoeba, skull etc) Interactive TV ???

  17. YOUR THOUGHTS

  18. Ευχαριστώ Dankie 谢谢！ متشکرم ありがとう！ (c) Multimedia Communications Research Laboratory (MCRLab) http://www.mcrlab.uottawa.ca

More Related