1 / 23

Pinnochio

This project tackles the limitations of current smart device peripherals, addressing high costs, power consumption, and functionality issues. Our goal is to develop a simple, useful, and efficient virtual input interface that utilizes facial recognition technology. By capturing and recognizing the user’s face through a camera, we facilitate cursor movement, button activation, and touch key emulation. We aim to provide a seamless user experience with a response time of less than 1/12 second, ensuring learnability and usability for users within minutes.

marie
Download Presentation

Pinnochio

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Pinnochio 성도윤 손명배 오승규

  2. What are we trying to solve?

  3. Too many peripherals

  4. Too power-consuming

  5. Too expensive That one seems O.K. $8895.00

  6. Limited Functionality

  7. Our Goal • Simple • Useful • Efficient

  8. Functional Requirements • Provide a virtual input interface for smart device • Using camera, capture the user’s face • Recognize the user’s face to control input • Behavior 1: Move cursor • Behavior 2: Button down or up • Behavior 3: TouchkeyEmulation • Configure

  9. Threshold-based approach

  10. Technical Challenges • Face Recognition • Position • Orientation • Features (Eye, Mouth) • Motion Recognition • O/S Integration • Power Saving

  11. Functional Requirements • Provide a virtual input interface for smart device • Using camera, capture the user’s face • Recognize the user’s face to control input • Behavior 1: Move cursor • Behavior 2: Button down or up • Behavior 3: TouchkeyEmulation • Activate/Deactivate • Configure

  12. Use Cases

  13. Use Cases

  14. Architectural Diagram Pinocchio

  15. Class Diagram

  16. Sequence DiagramFrame Processing

  17. Sequence DiagramMove Pointer

  18. Software Quality Attributes Analysis • Efficiency (Time Behavior) • Response time < 1/12 sec • Functionality (Correctness) • Cursor movement direction is within 15˚ from the angle of tilted head • Usability (Learnability) • 90% learn how to use the systemwithin5 minutes. • 90% can set their touchkey motions within3 minutes.

  19. Technical Challenges • Face Recognition: Position, Orientation • Android API supporting face detection • Face Recognition : Features (Eye, Mouth) • Luminosity algorithm • Motion Recognition • Curve difference • Threshold • O/S Integration • Build custom driver for virtual pointing device • Power Saving • Allow users to deactivate process when it is not needed.

  20. Project Milestones • Apr 30 • Finish face recog. and kernel mod. separately • May 7 • Finish integrating two parts into single device • Determine touchkey motions • May 14 • Finish polishing • Final verification • May 16 • Final presentation

More Related