1 / 28

A Sample Recognition Problem

A Sample Recognition Problem. Joseph Tighe University of North Carolina at Chapel Hill. What is recognition?. What is recognition?. What is recognition?. What is recognition?. Figure from Shotton et al. (2009).

nash
Download Presentation

A Sample Recognition Problem

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. A Sample Recognition Problem Joseph Tighe University of North Carolina at Chapel Hill

  2. What is recognition?

  3. What is recognition?

  4. What is recognition?

  5. What is recognition? Figure from Shotton et al. (2009) He et al. (2004), Hoiem et al. (2005), Shotton et al. (2006, 2008, 2009), Verbeek and Triggs (2007), Rabinovich et al. (2007), Galleguillos et al. (2008), Gould et al. (2009), etc.

  6. What is recognition? • Have some entity • photo • bounding box in photo • pixel • Assign semantic meaning • scene type, tags, sentence • object label, action • semantic class, material, geometric orientation

  7. Our Problem • Entity: Images • Goal: Assign 1 of 4 labels (airplane, car, face, motorbike

  8. Finding Similar Images

  9. Ocean Forest Open Field Mountain Which image is most similar? Highway Inner City Then assign the label from the most similar image Street Tall Building What is depicted in this image?

  10. Pixels are a bad measure of similarity Most similar according to pixel distance Most similar according to “Bag of Words”

  11. Origin of the Bag of Words model • Orderless document representation: • frequencies of words from a dictionary Salton & McGill (1983) US Presidential Speeches Tag Cloudhttp://chir.ag/phernalia/preztags/

  12. What are words for an image?

  13. Wing Tail Propeller Building Wheel

  14. Wing Building Wheel Propeller Jet Engine Tail

  15. Wing Building Wheel Propeller Jet Engine Tail

  16. Wing Building Wheel Propeller Jet Engine Tail

  17. But where do the words come from?

  18. Then where does the dictionary come from?

  19. Example Dictionary Source: B. Leibe

  20. … … … Another dictionary Source: B. Leibe

  21. Fei-Fei et al. 2005

  22. Outline of the Bag of Words method • Divide the image into patches • Assign a “word” for each patch • Count the number of occurrences of each “word” in the image

  23. Matlab Demo

More Related