learning the appearance of faces a unifying approach for the analysis and synthesis of images l.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
Learning the Appearance of Faces: A Unifying Approach for the Analysis and Synthesis of Images. PowerPoint Presentation
Download Presentation
Learning the Appearance of Faces: A Unifying Approach for the Analysis and Synthesis of Images.

Loading in 2 Seconds...

play fullscreen
1 / 23

Learning the Appearance of Faces: A Unifying Approach for the Analysis and Synthesis of Images. - PowerPoint PPT Presentation


  • 165 Views
  • Uploaded on

Learning the Appearance of Faces: A Unifying Approach for the Analysis and Synthesis of Images. Thomas Vetter. University of Freiburg. Germany. http://graphics.informatik.uni-freiburg.de. Computer Vision & Computer Graphics.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Learning the Appearance of Faces: A Unifying Approach for the Analysis and Synthesis of Images.' - drew


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
learning the appearance of faces a unifying approach for the analysis and synthesis of images

Learning the Appearance of Faces:A Unifying Approach for the Analysis and Synthesis of Images.

Thomas Vetter

University of Freiburg

Germany

http://graphics.informatik.uni-freiburg.de

computer vision computer graphics
Computer Vision & Computer Graphics

Vision ( image) parameters

image Graphics ( parameters )

-1

G( image ) Parameters

| G(p) - I |2 = minParameters

Computer Graphics can help to solve Computer Vision!

analysis by synthesis
Analysis by Synthesis

model parameter

Analysis

Image Model

Synthesis

Image

3D

World

Image Description

synthesis of faces
Synthesis of Faces

Database

Morphable

Face Model

Face

Analyzer

3D Head

Modeler

Result

Input Image

approach example based modeling of faces
Approach: Example based modeling of faces

2D Image 3D Face Models

= w1 * + w2 * + w3 * + w4 * +. . .

cylindrical coordinates
Cylindrical Coordinates

h

f

h

f

red(h,f)

green(h,f)

blue(h,f)

radius(h,f)

morphing 3d faces
Morphing 3D Faces

1

__

2

3D Blend

3D Morph

1

__

=

+

2

correspondence a two step process
Correspondence: A two step process!

2nd Example

Example

Reference

  • Correspondence between
      • two examples ( Optical Flow like algorithms).
      • many examples ( Morphable Model )
vector space of 3d faces
Vector space of 3D faces.
  • A Morphable Model can generate new faces.

a1 * + a2 * + a3 * + a4 * +. . .

=

b1 * + b2 * + b3 * + b4 * +. . .

modelling in face space
Modelling in Face Space

Caricatur

Original

Average

modelling the appearance of faces
Modelling the Appearance of Faces

A face is represented as a point in face space.

  • Which directions code for specific attributes ?
learning from labeled example faces
Learning from Labeled Example Faces

Fitting a (linear) regression function

facial attributes
Facial Attributes

Subjective Attractiveness

Weight

Original

transfer of facial expressions
Transfer of Facial Expressions

-

= Smile

Novel Face:

+ Smile =

Originals:

3d shape from images
3D Shape from Images

Face

Analyzer

Input Image

3D Head

matching a morphable 3d face model
Matching a Morphable 3D-Face-Model

Optimization problem!

a1 * + a2 * + a3 * + a4 * +. .

= R

b1 * + b2 * + b3 * + b4 * +. .

error function
Error Function
  • Image difference
  • Plausible parameters
  • Minimize
optimization strategies
Optimization Strategies
  • Difference Decomposition
  • Stochastic Gradient Decent
future challenges
Future Challenges
  • Which Object Classes are linear ?
  • How to built them automatically?