feature detection and emotion recognition n.
Skip this Video
Loading SlideShow in 5 Seconds..
Feature Detection and Emotion Recognition PowerPoint Presentation
Download Presentation
Feature Detection and Emotion Recognition

Loading in 2 Seconds...

play fullscreen
1 / 22

Feature Detection and Emotion Recognition - PowerPoint PPT Presentation

  • Uploaded on

Feature Detection and Emotion Recognition. Chris Matthews Advisor: Prof. Cotter. Motivation #1: Attempt to Answer a Long-Existing Question.

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
Download Presentation

PowerPoint Slideshow about 'Feature Detection and Emotion Recognition' - demi

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
feature detection and emotion recognition

Feature Detection and Emotion Recognition

Chris Matthews

Advisor: Prof. Cotter

motivation 1 attempt to answer a long existing question
Motivation #1: Attempt to Answer a Long-Existing Question
  • Used to definitively characterize what expressions the Mona Lisa is displaying (F.Y.I., she is 83% happy, 9% disgusted, 6% fearful and 2% angry, according to BBC News)
motivation 2 create life like robots
Motivation #2: Create “Life-Like” Robots
  • Create convincingartificial intelligence.
motivation 3 enhance society
Motivation #3: Enhance Society!
  • Currently being used to teach autistic children to pick out facial subtleties and their corresponding emotions


  • Isolate and crop particular areas of the face



      • Train neural networks for each area
      • Combine the resultants from each and come out with a definitive result
      • Alter variables of the networks by trial-and-error until the desired results are achieved


      • Input new photos into the trained network and check results
feature detection susan filtering for edge detection
Feature Detection:SUSAN filtering for Edge Detection
  • Because no derivatives are implemented in SUSAN, the algorithm excels in noisy images
massive problem boolean images don t necessarily make computer vision problems easier
Mouth not fully enclosed

Only the pupil of the left eye is enclosed

Even if everything was perfectly encapsulated, how would one make sense of the detected objects?

Massive Problem: Boolean images don’t necessarily make Computer Vision problems easier!
lesson learned complete automation is difficult
Lesson Learned: Complete Automation is difficult!
  • New methodology for isolating parts of the face – manual labor.
  • Draw matrices over the approximate area of interest
  • Apply filters to detect the actual object of interest
  • Crop again based on those findings
on to the emotion training
On to the Emotion Training…
  • Once the areas have been defined and scaled, they can be used as inputs to neural networks
perceptron implementation
Perceptron Implementation
  • Initialize weight matrix and bias array to small, random values.
  • Feed an image through the network
  • Calculate the error
  • Readjust the weight matrix and bias array based on the error
  • Iteratively train the network using a dictionary of photos.
yet another problem
Yet another problem!
  • Each neuron has one weight value for each pixel
  • Weight matrix is too large to train!
solution pca
Solution: PCA
  • Principle Component Analysis generates a set of eigenvectors.
  • Each picture can be reconstructed using a weighted sum of these eigenvectors.
final architecture
Final Architecture
  • Use a set of adaptive backpropagation networks, training on PCA coefficients.
  • Use majority rules to determine the emotion.
  • Training with 60 photos yielded 100% accuracy mapping to only two targets: happy and sad
  • Training with 112 photos yielded 60% accuracy mapping to four targets: angry, fearful, happy, and sad.
future work
Future Work
  • Find larger and more diverse image dictionaries
  • Improve Feature Detection
  • Read Psychological Journals and apply their findings into the algorithms
a gross simplification of how susan works
A gross simplification of how SUSAN works
  • Smallest Univalue Segment Assimilating Nucleus
  • Edge if n = (½)*pi*r^2
  • Corner if n << (½)*pi*r^2