1 / 27

Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited

Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited . Diane Kelly School of Information and Library Science University of North Carolina at Chapel Hill, USA. Once upon a time …. Explicit-O- Saurus. User-Model-O- Saurus. Implicit-O- Saurus.

ovidio
Download Presentation

Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Relevance Feedback for the Modern Searcher: Elicitation Techniques Revisited Diane KellySchool of Information and Library ScienceUniversity of North Carolina at Chapel Hill, USA

  2. Once upon a time … Explicit-O-Saurus

  3. User-Model-O-Saurus

  4. Implicit-O-Saurus

  5. The Story of Explicit-O-Saurus • Review (some) past and present use of explicit feedback techniques • Relevance feedback (short-term) (document and term) • User modeling (long-term) • Present typical explanations for why these techniques are not used by searchers • Argue that these explanations are no longer adequate

  6. 1950s: Luhn’s Selective Dissemination of Information Schultz, C. K. (1968). H.P. Luhn: Pioneer of Information Science (p.32). London, UK: American Documentation Institute.

  7. 1960s: Salton, Rocchio, and Ide Ide, E. (1967). User interaction with an automated information retrieval system. In G. Salton (Ed.) Information Storage and Retrieval: Scientific Report No. ISR-12.

  8. 1970s: Oddy’sThomas Oddy, R. N. (1977). Information retrieval through man-machine dialogue. Journal of Documentation, 33(1), 1-14.

  9. 1980s: User Modeling Rich, E. (1983). Users are individuals: Individualizing user models. International Journal of Human-Computer Studies, 51, 323-338. “While the term ‘user model’ emphasizes the information about the person, it is obvious that a great deal of situational, task, or environmental information may be encoded in the model.” Allen, R. B. (1990). User models: Theory, method, and practice. International Journal of Man-Machine Studies, 32, 511-543.

  10. 1980s: Intelligent IR Croft, W. B., & Thompson, R. H. (1987). I3R: A new approach to the design of document retrieval systems. Journal of the American Society for Information Science, 38, 389-404.

  11. 1990s: Agents Maes, P. (1994). Agents that reduce work and information overload. CACM, 37(7), 30-40.

  12. SYSTEM USER

  13. 1990s: And Some Visualization Cat-a-Cone: An Interactive Hearst, M. A. & Karadi, C. (1997). Cat-a-Cone: An Interactive Interface for Specifying Searches and Viewing Retrieval Results using a Large Category Hierarchy. Proc. of SIGIR ‘97.

  14. 1990s: And more relevance feedback Belkin, N. J., Cool, C., Kelly, D., Lin, S.-J., Park, S.Y., Perez-Carballo, J., & Sikora, C. (2001). Iterative exploration, design and evaluation of support for query reformulation in interactive information retrieval. Information Processing & Management 37(3), 404-434.

  15. 2000s: Implicit Feedback • Click-through • Dwell time • Scrolling • Queries But explicit feedback is not really dead …

  16. Date Viewed Online: October 12, 2010

  17. http://www.movielens.org/rateMore and http://www.grouplens.org/ Dates Viewed Online: October 12 and December 06, 2010

  18. Date Viewed Online: November 11, 2010

  19. Date Viewed Online: November 11, 2010

  20. Date Viewed Online: November 11, 2010

  21. Date Viewed Online: December 06, 2010

  22. http://hunch.com/ Date Viewed Online: October 12, 2010

  23. What Caused the Supposed Demise of Explicit Feedback? • Users are unwilling to put forth the effort required to provide feedback • Users don’t have the additional cognitive resources to engage in explicit feedback

  24. REASON 1: Users are unwilling to put forth the effort required to provide feedback. REALLY? http://www.pewinternet.org/ http://www.visualeconomics.com/how-the-world-spends-its-time-online_2010-06-16/

  25. REASON 2: Users don’t have the additional cognitive resources to engage in explicit feedback. • Well, maybe back then …

  26. A Future for Explicit Feedback • Better questions • Better measures Focused on information-seeking support not information search support. • More creative • More engaging • More adaptive “While the term ‘user model’ emphasizes the information about the person, it is obvious that a great deal of situational, task, or environmental information may be encoded in the model.” (Allen, 1990)

  27. A Future for Explicit Feedback

More Related