1 / 38

Language and images

Language and images. Abhijit Sarkar. Adjective. Noun. Verbs. Adverbs. Sentence source - UIUC Sentence dataset Comparison using Gist : 4X4 window Test picture source – VOC2012 No object detectors . Using only same category. Rank 2. River Water Red Banking maneuvers. Low Plane Day

amaris
Download Presentation

Language and images

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Language and images AbhijitSarkar

  2. Adjective Noun Verbs Adverbs

  3. Sentence source - UIUC Sentence dataset • Comparison using Gist : 4X4 window • Test picture source – VOC2012 • No object detectors

  4. Using only same category

  5. Rank 2 River Water Red Banking maneuvers Low Plane Day gray

  6. When testing with other category

  7. Rank 1

  8. Rank 2

  9. Rank 2

  10. Test with any picture • Take top 10 ranked results (10 out of 1000) • Try to identify the best

  11. Not so Good results

  12. And some Really Bad …….

  13. Conclusion • Good Results - – includes sky or similar ambience • Airplane • Horse • Bike • Indoor scene • Sofa • Bad Results • Cat • Dog • Birds

  14. Gender

  15. Gender Age Nationality

  16. Direction Left/ Right Front/ Side

  17. Details Direction

  18. Minute Details

  19. Conclusion • “Sentences are richer than lists of words, because they describe activities, properties of objects” • We use words like “peaceful”, “Calm”, “Turbulent”, “sweet”, “lone”

  20. Thanks • Acknowlegements • Dr. Devi Parikh image Credit : Jamie Shotton

More Related