the pyramid match kernel discriminative classification with sets of image features l.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
The Pyramid Match Kernel: Discriminative Classification with Sets of Image Features PowerPoint Presentation
Download Presentation
The Pyramid Match Kernel: Discriminative Classification with Sets of Image Features

Loading in 2 Seconds...

play fullscreen
1 / 27

The Pyramid Match Kernel: Discriminative Classification with Sets of Image Features - PowerPoint PPT Presentation


  • 398 Views
  • Uploaded on

The Pyramid Match Kernel: Discriminative Classification with Sets of Image Features. Kristen Grauman Trevor Darrell MIT. Sets of features. invariant region descriptors. local shape features. examples under varying conditions. Sets of features. Problem.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

The Pyramid Match Kernel: Discriminative Classification with Sets of Image Features


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
the pyramid match kernel discriminative classification with sets of image features

The Pyramid Match Kernel: Discriminative Classification with Sets of Image Features

Kristen Grauman

Trevor Darrell

MIT

sets of features3

invariant region descriptors

local shape features

examples under varying conditions

Sets of features
problem
Problem

How to build a discriminative classifier using the set representation?

  • Kernel-based methods (e.g. SVM) are appealing for efficiency and generalization power…
  • But what is an appropriate kernel?
  • Each instance is unordered set of vectors
  • Varying number of vectors per instance
existing set kernels

Compute pair-wise similarity between all vectors in each set

  • Wallraven et al., Lyu, Boughhorbel et al.
  • General family of algebraic functions combining local (vector) kernels
  • Shashua & Hazan

High complexity

Existing set kernels
  • Fit(parametric) model to each set, compare with distance over models

Kondor & Jebara, Moreno et al., Lafferty & Lebanon, Cuturi & Vert,

Wolf & Shashua

Restrictive assumptions

Ignoring set statistics

partial matching for sets of features
Partial matching for sets of features

Compare sets by computing a partialmatching between their features.

Robust to clutter, segmentation errors, occlusion…

pyramid match overview
Pyramid match overview

Pyramid match kernel measures similarity of a partial matching between two sets:

  • Place multi-dimensional, multi-resolution grid over point sets
  • Consider points matched at finest resolution where they fall into same grid cell
  • Approximate similarity between matched points with worst case similarity at given level

No explicit search for matches!

pyramid match kernel

Number of newly matched pairs at level i

Measure of difficulty of a match at level i

Pyramid match kernel

Approximate partial match similarity

feature extraction

,

Histogram pyramid: level i has bins of size 2i

Feature extraction
counting matches
Counting matches

Histogram intersection

counting new matches

matches at this level

matches at previous level

Difference in histogram intersections across levels counts number ofnew pairs matched

Counting new matches

Histogram intersection

pyramid match kernel13

histogram pyramids

number of newly matched pairs at level i

measure of difficulty of a match at level i

Pyramid match kernel
  • Weights inversely proportional to bin size
  • Normalize kernel values to avoid favoring large sets
efficiency
Efficiency

For sets with m features of dimension d, and pyramids with L levels, computational complexity of

Pyramid match kernel:

Existing set kernel approaches:

or

example pyramid match
Example pyramid match

pyramid match

optimal match

slide19

Approximation of the optimal partial matching

[Indyk & Thaper]

Matching output

Trial number (sorted by optimal distance)

100 sets with 2D points, cardinalities vary between 5 and 100

building a classifier
Building a classifier
  • Train SVM by computing kernel values between all labeled training examples
  • Classify novel examples by computing kernel values against support vectors
  • One-versus-all for multi-class classification

Convergence is guaranteed since pyramid match kernel is positive-definite.

object recognition results
Object recognition results
  • ETH-80 database 8 object classes
  • Features:
    • Harris detector
    • PCA-SIFT descriptor, d=10

Eichhorn and Chapelle 2004

object recognition results22
Object recognition results
  • Caltech objects database 101 object classes
  • Features:
    • SIFT detector
    • PCA-SIFT descriptor, d=10
  • 30 training images / class
  • 43% recognition rate

(1% chance performance)

  • 0.002 seconds per match
localization
Localization
  • Inspect intersections to obtain correspondences between features
  • Higher confidence correspondences at finer resolution levels

target

observation

pyramid match regression
Pyramid match regression
  • Pose estimation from contour features
  • Train SVR with CG data
  • Features: shape context histograms
summary pyramid match kernel
Summary: Pyramid match kernel

optimal partial matching between sets of features

difficulty of a match at level i

number of new matches at level i

summary pyramid match kernel26
Summary: Pyramid match kernel
  • A new similarity measure based on implicit correspondences that approximates the optimal partial matching
    • linear time complexity
    • no independence assumption
    • model-free
    • insensitive to clutter
    • positive-definite function
    • fast, effective object recognition
future work
Future work
  • Geometric constraints
  • Fast search of large databases with the pyramid match for image retrieval
  • Use as a filter for a slower, explicit correspondence method
  • Alternative feature types and classification domains