1 / 5

Virtual Assistants for Mobile Devices Using Voice and Gesture Technologies

Virtual Assistants for Mobile Devices Using Voice and Gesture Technologies. Kishore Prahallad (IIIT-H), Radhika Mamidi (IIIT-H), Anoop Namboodri (IIIT-H), Sandhya Kode (IIIT-H), Shobha Reddy (Methodist college of Engg .), N Balaji ( VNR college of Engg ). Need for futuristic interfaces.

teryl
Download Presentation

Virtual Assistants for Mobile Devices Using Voice and Gesture Technologies

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Virtual Assistants for Mobile Devices Using Voice and Gesture Technologies Kishore Prahallad (IIIT-H), Radhika Mamidi (IIIT-H), Anoop Namboodri (IIIT-H), Sandhya Kode (IIIT-H), Shobha Reddy (Methodist college of Engg.), N Balaji(VNR college of Engg).

  2. Need for futuristic interfaces • Existing keyboard/touch based interfaces are not handsfree • Hard to workwith, and are not handsfree • Usage is limited to literate and abled-persons • Proposal - a futuristic interface • Enables literate and illiterate, differently-abled to use the mobile devices • Communication, information retrieval and entertainment • Uses voice and gesture based technologies for a multi-modal mobile interaction and computing

  3. Virtual assistant • Voice commands • Call my doctor • Sufficient knowledge of user and context built in • Converse (dialog) with the device for information access • Could you check whether train tickets are available to Tirupati tomorrow? • Gesture based recognition • hand-"write" SMS/Emails • Technologies: speech recognition, natural understanding, expressive speech synthesis, gesture recognition, affective state modeling • Applications: multimodal interfaces for information access (socionity), differently-abled, teaching and learning.

  4. VNRVJIET : Design of Multimodal Communication Interface • Objective : The objective of this research proposal is to design a Multimodal human computer interface software which helps in addressing the communication & interaction needs of People with Autism • The Software must support all possible modalities like text, voice, touch & eye gestures in providing required assistance to people with Autism in the areas of • Communication, Speech Development, Social Interaction, Computer Aided Learning, Assessment of Learning skills

  5. Affective HCI: Role of Speech Prosody To integrate human emotions in intelligent HCI for improved interpersonal communication: - An interface between human and computer sensitive to humans affective state . The interface sense, process and interpret the prosody features like pitch, stress, rhythm and speech rate, etc. Accordingly, the recipient mobile indicates an icon which changes in real time according to the emotional state of the user. Investigator: Methodist College Of Engineering & Technology

More Related