1 / 12

EyeMouse: Interaction Device for Severely Motor-Disabled Individuals

"The EyeMouse is a human-machine interaction system designed to replace the traditional mouse with eye movements for severely motor-disabled individuals, such as those with multiple sclerosis. It captures user eye movements through computer vision and translates them into commands for on-screen interface interaction. The device employs elastic template matching to capture external eye and iris positions, enabling accurate remapping onto the screen plane. User feedback compensates for remapping errors, enhancing navigation and selection functionalities. The current work focuses on accommodating head motion and automatic error recovery for extended user interaction."

hart
Download Presentation

EyeMouse: Interaction Device for Severely Motor-Disabled Individuals

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. “EyeMouse”: An interaction device for severely motor-disabled people Carlo Colombo, Massimiliano Corsini Media Integration and Communication Center University of Florence

  2. EyeMouse • Human-machine interaction system replacing the mouse with eye movements • Designed to exploit the residual mobility of severely motor-disabled people (e.g. multiple sclerosis)

  3. Interaction • User eye movements are captured through computer vision… • …and then transformed into commands for the on-screen PC interface CVInterpreter Interface commands Live camera images User Screen action feedback

  4. Eye capture • External eye and iris are captured by elastic template matching (snakes) Snake template Iris (circle) external eye (ellipse)

  5. Eye remapping Image plane Screen plane • The iris position in the image is remapped onto the screen plane • The image-to-screen map is calibrated at startup

  6. Mouse functionalities • Navigation: eye movements • Selection: eye persistence, eye blinks • Interface feedback compensates for slight remapping errors

  7. “X” movement

  8. “O” movement

  9. Current work • Accommodation of head motion • Automatic recovery of tracking errors for prolongated interaction

  10. Contacts Prof. Carlo Colombo Dipartimento Sistemi e Informatica Via S. Marta 3 – Firenze Centro di Eccellenza MIUR per la Comunicazione e Integrazione dei Media Sede RAI, Largo A. de Gasperi 1 - Firenze www.dsi.unifi.it/users/colombo colombo@dsi.unifi.it

More Related