1 / 14

Adaptive Image Ranking for Search Engines Using Gaussian Processes

Learn how to improve image search through instance preference learning by Gaussian processes, incorporating user feedback for ranking optimization. Future directions include HCI enhancement and learning from various sources.

quang
Download Presentation

Adaptive Image Ranking for Search Engines Using Gaussian Processes

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. User Adaptive Image Ranking for Search Engines Maryam Mahdaviani Nando de Freitas Laboratory for Computational Intelligence University of British Columbia

  2. Word Polysemy is a common problem in IR system • Screen shot of apple/red apple/red apple fruit • Screen shot of tiger Image Retrieval systems mainly use linguistic features (e.g. words) and not visual cues

  3. legend before after

  4. Page 2 Page 3 Page 11

  5. How do we do it? Instance Preference Learning by Gaussian Processes • We want to learn a better ranking from m pair-wise relations: for • We use the standard hierarchical Bayes probit model [Hebrich et al, NIPS 06; Wei Chu et al, ICML 05]

  6. How do we do it? Instance Preference Learning by Gaussian Processes • It then follows that : • The posterior can be easily computed either using MCMC, Laplace’s method, mean field or Expectation Propagation.

  7. legend beforeafter

  8. Can also do Active Preference Learning • The system prompts user with intelligent questions to increase the confidence in ranking • The user can stop questioning once she is annoyed • The system re-ranks the images based on the preferences • We calculate for each unlabeled pair; pick the maximum and query the user accordingly[Wei Chu et al, NIPS 05]

  9. legend beforeafter ?

  10. legend Water is hard

  11. Conclusion and Future Directions • We applied state-of-the-art preference learning algorithm for image ranking • In future we should work on: Improving the HCI Improving the vision Conducting using study Expand the idea to other search Learning from many sources

  12. Thank You! Questions? Feedback? Acknowledgment: The code for this work has been built on Wei Chu’s supervised preference learning package, which is available online

More Related