1 / 16

Overview on Gesture Recognition

Overview on Gesture Recognition. Spring Semester, 2010. Gesture. A form of  non-verbal communication  in which visible bodily actions communicate particular messages Include movement of the  hands , face , or other parts of the  body. Gesture Recognition. Vision / Wave Wearable-sensor

bree-simon
Download Presentation

Overview on Gesture Recognition

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Overview on Gesture Recognition Spring Semester, 2010

  2. Gesture • A form of non-verbal communication in which visible bodily actions communicate particular messages • Include movement of the hands, face, or other parts of the body

  3. Gesture Recognition • Vision / Wave • Wearable-sensor • Acceleration / Gyro • …

  4. Vision and Wave • MS • Project natal • Nokia • 3D device control interface by using ultrasonic transducers

  5. Wearable Sensors

  6. Accelerometer • Nintendo Wii • Mobile phones

  7. Accelerometers on Mobile Phones

  8. Today’s Paper • Natural Throw and Tilt Interaction between Mobile Phones and Distant Displays -Dachselt, R. and Buchholz, R. presented in CHI 2009 • Throw and Tilt – Seam-less Interaction across Devices Using Mobile Phone Gestures -Dachselt, R. and Buchholz, R., MEIS 2008

  9. Goal • Combine the mobile phones with large displays • Most mobile phones are able to store and manage all kinds of personal information and media • All of these devices are inherently limited in terms of their screen size and amount of information they can display

  10. Throw and Tilt • Use intuitive throwing gestures to transfer personal media data such as music, pictures, diary entries and map locations to a large screen • Use a simple, intuitive, and generic set of tilt gestures to ensure natural interaction

  11. Tilt Interaction • Gesture set • Linear mapping

  12. Throwing Data • Throw • Use a threshold of the Euclidean length of the raw force vector delivered by the sensor • Fetch-back

  13. Application Scenarios • The zoomable music browser • Image / media browser • Geo-Referenced Data on Maps

  14. Demo

  15. Summary and Discussion • Give a brief overview on gesture recognition • The simple but powerful gestures can be used to control various applications • Additional application scenarios: Combining private mobile and public displays Multi-user collaboration, proximity, and directionality of devices

More Related