1 / 13

Facial Gesture Recognition: A Novel HCI model

Facial Gesture Recognition: A Novel HCI model. Mentees: Chun Yang, Rishi Ratan Mentor: Sanketh Shetty. Overview. What is facial gesture recognition? Methodology Applications. Last Semester. Methodology. Use OpenCV to isolate faces in video Find a way to detect facial motion

alanna
Download Presentation

Facial Gesture Recognition: A Novel HCI model

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Facial Gesture Recognition: A Novel HCI model Mentees: Chun Yang, Rishi Ratan Mentor: Sanketh Shetty

  2. Overview What is facial gesture recognition? Methodology Applications

  3. Last Semester

  4. Methodology • Use OpenCV to isolate faces in video • Find a way to detect facial motion - Optical Flow - Phase Correlation • Classify results from motion detection using support vector machines

  5. Optical Flow • Estimate apparent motion in two consecutive frames • Find feature points in frame • Track the features from one frame to the next • Motion can be inferred from the movement of feature points

  6. Optical Flow

  7. Optical Flow • Flaws: • Susceptible to noise • Good feature points rely on presence of edges; lack of edges on face degrades the method's effectiveness

  8. Phase Correlation • Utilize Fast Fourier Transforms (FFT) to compute translational offsets • Apply Hamming window to reduce spectral leakage • Calculate DFT of two frames and obtain the cross-power spectrum • Normalize and apply inverse Fourier transform • Peaks in result of IDFT correspond to offsets

  9. Phase Correlation (0, -16)

  10. Support Vector Machines • Given an input consisting of labels and data, draw a hyperplane that maximizes the margin between two sets of data

  11. Phase Correlation: Example

  12. Future Work/Applications • Effectiveness of phase correlation in facial gesture recognition can be explored further • Facial gestures could be used as a new HCI model in video games and immersive environments • Opera Web Browser Face Gestures • Method could be used in vehicles to alert drivers who are about to fall asleep

  13. Acknowledgments • We would like to thank: • Prof. Brunet and the PURE Committee. • Our mentor Sanketh Shetty • Finally YOU, for being so considerate. Questions/Comments?

More Related