1 / 9

HAND GESTURE BASED HUMAN COMPUTER INTERACTION

HAND GESTURE BASED HUMAN COMPUTER INTERACTION. Hand Gesture Based Applications. Computer Interface A 2D/3D input device (Hand Tracking) Translation of gestures to commands More natural interface for 3D design applications Aid for disabled and deaf people Sign language analysis, translation

czechm
Download Presentation

HAND GESTURE BASED HUMAN COMPUTER INTERACTION

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. HAND GESTURE BASEDHUMAN COMPUTER INTERACTION

  2. Hand Gesture Based Applications • Computer Interface • A 2D/3D input device (Hand Tracking) • Translation of gestures to commands • More natural interface for 3D design applications • Aid for disabled and deaf people • Sign language analysis, translation • Sign language teaching • Using multimodality to enable communication between disabled people • Entertainment • Applications involving hand gesture recognition, from computer games to sound and image design applications

  3. The System HMM Based Hand Gesture Recognition Process 3D Reconstruction 2D Kalman Filter Marker Segmentation Vector Quantizer 3D Kalman Filter Left Image Right Image Gesture Spotter Application

  4. Gesture Recognition System Setup • Requirements: • 2D Gesture Recognition System: • A simple webcam capable of acquiring RGB images • 3D Gesture Recognition System: • Two simple webcams capable of acquiring RGB images • A mainboard capable of handling two webcams • No special equipment required

  5. Gesture Recognition System Setup

  6. 3D GESTURES

  7. Capabilities • Recognition of 2D and 3D gestures in real time • Real time hand tracking – controlling mouse motion • Capability of triggering windows input device events – controlling third party applications

  8. Future Work • Usage of IOHMM, HMM ANN hybrids • A visualization module for the HMMs • Combining with body and face analyzers • Real time recognition of simple sign language gestures • Inclusion of hand posture in recognition process

  9. Demonstration Finger Tracker.avi

More Related