Arabic sign language recognition
This presentation is the property of its rightful owner.
Sponsored Links
1 / 23

Arabic Sign Language Recognition PowerPoint PPT Presentation


  • 172 Views
  • Uploaded on
  • Presentation posted in: General

Arabic Sign Language Recognition. Mohamed Mohandes King Fahd University of Petroleum and Minerals [email protected] OUTILNE. Introduction Sign Language Recognition Translation of text to sign language Conclusion and future work. Importance of Sign Language.

Download Presentation

Arabic Sign Language Recognition

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Arabic Sign Language Recognition

Mohamed Mohandes

King Fahd University of Petroleum and Minerals

[email protected]


OUTILNE

  • Introduction

  • Sign Language Recognition

  • Translation of text to sign language

  • Conclusion and future work


Importance of Sign Language

  • Arabic sign language (ARSL) is different from spoken Arabic language in terms of grammars, vocabulary, and delivery.

  • ARSL is the natural language for deaf like spoken language to vocal

  • Sign language is different from country to other (Australia, UK, USA)

  • 100,000 deaf and hearing impaired in KSA


Objectives

Using Computers to make life of deaf easier and integrating them in the society :

  • Translating ARSL to spoken language

  • Translating Arabic speech to ARSL


ARSL Recognition

  • Image based

    • Requires special set up for camera

    • Heavy computational load to extract hands

  • Electronic-Glove based

    • Inconvenience of gloves

    • Ease of signal extractions


Translating ARSL to Speech

سلمان


System Components


CyberGlove


CyberGlove

  • 22 sensors

  • Light weight

  • Flexible


Tracking System


Sensor signals for two different words


Coordinates of wordمع السلامة

Coordinates of word الله


الاشارات المعتمدة

المنظمة العربية

للتربية والثقافة والعلوم

الاتحاد العربي

للهيئات العاملة في رعاية الصم


1300 signs

344 single

handed


Data Collection

344 single handed signs

6880 Samples

6880 samples

20 samples from every sign: 15 for training and 5 for testing


Support Vector Machine


SVM


System Performance

  • Time segments and Principle Component Analysis for feature extraction

  • Correct recognition rate of 98.33%


Analysis of Misclassified Signs

Frames of sign of letter “س”

Frames of sign of letter “ش”


Analysis of Misclassified Signs

Frames from the sign “employee”

Frames from the sign “Down syndrome”


Analysis in Feature space

Hand shape of “employee”

Hand shape of “Down syndrome”


Translating Speech to ARSL

سلمان

ســـــــــــلمان


Conclusions and Future work

  • Developed a Real-time single-handed Arabic sign language recognition system with accuracy of 98.33%

  • Working on two-handed signs recognition

  • Developing our own smart glove for Arabic Sign Language

  • Mapping of signs to roots for speech to sign translation


  • Login