automatic face recognition under component based manifolds
Download
Skip this Video
Download Presentation
Automatic Face Recognition under Component-Based Manifolds

Loading in 2 Seconds...

play fullscreen
1 / 23

Automatic Face Recognition under Component-Based Manifolds - PowerPoint PPT Presentation


  • 77 Views
  • Uploaded on

Automatic Face Recognition under Component-Based Manifolds. CVGIP 2006 Wen-Sheng Chu ( 朱文生 ) and Jenn-Jier James Lien ( 連震杰 ) Robotics Lab. CSIE NCKU. Motivation. Face recognition is hard due to several image variations :. expression. pose. illumination. Person A. Person A. Objective.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Automatic Face Recognition under Component-Based Manifolds' - ramona


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
automatic face recognition under component based manifolds

Automatic Face Recognition under Component-Based Manifolds

CVGIP 2006

Wen-Sheng Chu (朱文生) and Jenn-Jier James Lien (連震杰)

Robotics Lab. CSIE NCKU

motivation
Motivation
  • Face recognition is hard due to several image variations:

expression

pose

illumination

objective
Person A

Person A

Objective
  • Recognize faces using multiple face patterns rather than a single one.

Person B

Person B

Single input pattern

Multiple input patterns

automatic acquisition of facial components
Feature Point DetectionAutomatic Acquisition of Facial Components

Training Data of Features

Rejected Non-face

2-Class SVM Classifiers

Detected Features

Original Image

Cropped Face I

Face

Detection

Face +ve

Removal

Facial Components Extraction

Registration byAffine Warping

Band-pass

Filtering

Normalized

Pose IR

Normalized

Illumination IB

Extracted Facial Components

P. Viola and M. Jones, “Robust Real-Time Face Detection”, IJCV 2004.

automatic acquisition of facial components1
Feature Point DetectionAutomatic Acquisition of Facial Components

Training Data of Features

Rejected Non-face

2-Class SVM Classifiers

Detected Features

Original Image

Cropped Face I

Face

Detection

Face +ve

Removal

Facial Components Extraction

Registration byAffine Warping

Band-pass

Filtering

Normalized

Pose IR

Normalized

Illumination IB

Extracted Facial Components

facial feature detector
x

x

x

Facial Feature Detector
  • 2-class SVM with feature vector v:
  • Reject false positives

o

o

o

o

automatic acquisition of facial components2
Feature Point DetectionAutomatic Acquisition of Facial Components

Training Data of Features

Rejected Non-face

2-Class SVM Classifiers

Detected Features

Original Image

Cropped Face I

Face

Detection

Face +ve

Removal

Facial Components Extraction

Registration byAffine Warping

Band-pass

Filtering

Normalized

Pose IR

Normalized

Illumination IB

Extracted Facial Components

registration illumination normalization
Registration & Illumination Normalization

Registration

Affine warping

Band-pass filtering

Illumination

Normalization

automatic acquisition of facial components3
Feature Point DetectionAutomatic Acquisition of Facial Components

Training Data of Features

Rejected Non-face

2-Class SVM Classifiers

Detected Features

Original Image

Cropped Face I

Face

Detection

Face +ve

Removal

Facial Components Extraction

Registration byAffine Warping

Band-pass

Filtering

Normalized

Pose IR

Normalized

Illumination IB

Extracted Facial Components

facial components extraction
Facial Components Extraction
  • Effects of pose and illumination are smaller in each local region compared with those in the holistic face image.

T. K. Kim, H. Kim, W. Hwang and J. Kittler, “Independent Component Analysis in A Local Facial Residue Space for Face Recognition”, PR, 2004.

constrained mutual subspace method cmsm
Constrained Mutual Subspace Method (CMSM)
  • Similarity between i and j == θc
  • Use the variation of dissimilarity between subjects

subspace j

subspace i

θ

project

project

constrainedsubspace

θc

ic

jc

K. Fukui and O. Yamaguchi, “Face Recognition Using Multi-viewpoint Patterns for Robot Vision”, ISRR 2003.

constrained subspace generation
PCA basisConstrained Subspace Generation
  • Take nose for explanation:

The eigenvectors, w, selected in ascending order, are the basis of the constrained subspace, Snose.

Constraint subspace basis

projection onto constrained subspace
Projection onto Constrained Subspace
  • Projection

basis vectors  constrained subspace Snose

  • Normalization

length(projected vector)  1

  • Orthogonalization

applying Gram-Schmidt process to orthogonalize the normalized vectors

Snose

comparison between normalized manifolds
Comparison between Normalized Manifolds
  • The similarity of nose between subject i and subject j:

where are defined as the eigenvalues of matrix .

  • Similarity(i, j) == summing up the five canonical correlations
typical samples in 3d principal component space holistic image
Typical Samples in 3D Principal Component Space – Holistic Image

subject 1 (․)

subject 2 (․)

subject 3 (․)

subject 4 (․)

slide23
End

F&Q and thanks!

ad