1 / 19

By Yinan Zhao

Semantic Retrieval in Movie. --based on Buffy the vampire slayer. By Yinan Zhao. Buffy the vampire slayer. American television series Aired from March 10, 1997 until May 20, 2003 7 seasons, 144 episodes, 40 minutes per episode A story about vampire and the slayer Buffy Favorite scene.

macon
Download Presentation

By Yinan Zhao

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Semantic Retrieval in Movie --based on Buffy the vampire slayer By Yinan Zhao

  2. Buffy the vampire slayer • American television series • Aired from March 10, 1997 until May 20, 2003 • 7 seasons, 144 episodes, 40 minutes per episode • A story about vampire and the slayer Buffy • Favorite scene

  3. Image Retrieval in Google

  4. Video Retrieval in Google

  5. Google retrieval • Based on text description • Key word matching • For image, content-based retrieval exists • For video, no such method

  6. Video retrieval background • Video Google: A text retrieval approach to object matching in videos by Josef Sivic and Andrew Zisserman in 2003

  7. Video Google

  8. Video Google

  9. Video Google

  10. Video Google • Bag-of-Features based representation • “Visual words” through clustering • SIFT feature • Text retrieval method • Apply weighting to the vector of word frequencies • Website: http://www.robots.ox.ac.uk/~vgg/research/vgoogle/index.html

  11. Video retrieval background • Visual Semantic Search: Retrieving Videos via Complex Textual Queries by Dahua Lin, Sanja Fidler, Chen Kong, Raquel Urtasun

  12. Visual Semantic search • Improvements • Text and image alignment • Content based → concept based • complex natural language queries • Frame retrieval → chunk retrieval

  13. Visual Semantic Search

  14. What is next • How to locate the exact chunk in a long video? • How to handle coreference problem? • How to handle more complex natural language queries?

  15. Plan • Annotate data • Build an efficient algorithm to find the exact chunk • Build a model considering the timeline

  16. Thank you

More Related