1 / 9

Enhancing Human-Computer Interaction Through Hand Gesture-Based Applications

Explore the world of hand gesture-based human-computer interaction with this system. Features include translating gestures to commands, aiding disabled individuals, analyzing sign language, and more. It offers a natural interface for 3D design applications and enables communication between disabled people. The setup requires simple webcams and no special equipment. Capabilities include real-time tracking of 2D and 3D gestures, controlling mouse motion, and triggering events in third-party applications. Future work involves hybrid models, visualization modules, and real-time recognition of sign language gestures. Discover the potential of hand gestures in computer interaction with this innovative system.

czechm
Download Presentation

Enhancing Human-Computer Interaction Through Hand Gesture-Based Applications

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. HAND GESTURE BASEDHUMAN COMPUTER INTERACTION

  2. Hand Gesture Based Applications • Computer Interface • A 2D/3D input device (Hand Tracking) • Translation of gestures to commands • More natural interface for 3D design applications • Aid for disabled and deaf people • Sign language analysis, translation • Sign language teaching • Using multimodality to enable communication between disabled people • Entertainment • Applications involving hand gesture recognition, from computer games to sound and image design applications

  3. The System HMM Based Hand Gesture Recognition Process 3D Reconstruction 2D Kalman Filter Marker Segmentation Vector Quantizer 3D Kalman Filter Left Image Right Image Gesture Spotter Application

  4. Gesture Recognition System Setup • Requirements: • 2D Gesture Recognition System: • A simple webcam capable of acquiring RGB images • 3D Gesture Recognition System: • Two simple webcams capable of acquiring RGB images • A mainboard capable of handling two webcams • No special equipment required

  5. Gesture Recognition System Setup

  6. 3D GESTURES

  7. Capabilities • Recognition of 2D and 3D gestures in real time • Real time hand tracking – controlling mouse motion • Capability of triggering windows input device events – controlling third party applications

  8. Future Work • Usage of IOHMM, HMM ANN hybrids • A visualization module for the HMMs • Combining with body and face analyzers • Real time recognition of simple sign language gestures • Inclusion of hand posture in recognition process

  9. Demonstration Finger Tracker.avi

More Related