1 / 61

Using Metadata to Improve Search User Interfaces

Using Metadata to Improve Search User Interfaces. Marti Hearst UC Berkeley FLINT Workshop, August 2001. My Claims. Web Search is OK Gets people to the right starting points Web SITE search is NOT ok The best way to improve site search is NOT to make new fancy algorithms Instead ….

leeevans
Download Presentation

Using Metadata to Improve Search User Interfaces

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Using Metadata to Improve Search User Interfaces Marti Hearst UC Berkeley FLINT Workshop, August 2001

  2. My Claims • Web Search is OK • Gets people to the right starting points • Web SITE search is NOT ok • The best way to improve site search is • NOT to make new fancy algorithms • Instead …

  3. The best wasy to improve search: Improve the User Interface

  4. Recent Study by Vividence Research • Spring 2001, 69 web sites • The most common problems: • 53% had poorly organized search results • 32% had poor information architecture • 32% had slow performance • 27% had cluttered home pages

  5. Organizing Search Results • There is a lot of prior work on this • Cha-Cha (Chen et al. 1999) • Scatter-Gather clustering (Cutting et al. 93, Hearst et al. 1996) • Becoming more prevalent in web search too. • Teoma • Visimo • Northern Light

  6. Putting Results into Categories

  7. Usually doesn’t work well when drilling down, however

  8. Web Search Results Grouping • Drill down one category • Cannot mix and match categories • Probably isn’t all that useful • But …what about site search?

  9. A Taxonomy of WebSites high Complexity of Data low low high Complexity of Applications From Mecca et al., WebDB’99

  10. An Important Trend • Web sites generated from databases • Implications: • Web sites can adapt to user actions • Web sites can be instrumented

  11. Navigation on the Web • Web search engines are good at getting people to the right site. • But … what happens when the user reaches the site? Follow Links … or … Search

  12. text search An Analogy hypertext

  13. Goal: An All-Tertrain Vehicle • The best of both techniques • A vehicle that magically lays down track to suggest choices of where you want to go next based on what you’ve done so far and what you are trying to do • The tracks follow the lay of the land and go everywhere, but cross over the crevasses • The tracks allow you to back up easily

  14. GeoRegion + Time/Date + Topic + Role New interfaces are mixing and matching thesaurus-style metadata The question: how to do this effectively?

  15. Goals for Metadata Usage • Well-integrated with search • Provides useful hints of where to go next • Tailored to task as it develops • Personalized • Dynamic

  16. The FLAMENCO Project FLexible Access using MEtadata in Novel Combinations • Main goal: • Perform systematic studies to determine how metadata should be incorporated into search • Answer questions such as: • Given a set of user goals and a set of information: • How many metadata combinations to show? • What level of detail to show? • How best to preview and postview choices?

  17. Evaluation Methodology • Regression Test • Select a set of tasks • Use these throughout the evaluation • Start with a baseline system • Evaluate using the test tasks • Add a feature • Evaluation again • Compare to baseline • Only retain those changes that improve results

  18. Recipe Example

  19. soar.berkeley.edu/recipes

  20. soar.berkeley.edu/recipes

  21. soar.berkeley.edu/recipes

  22. www.epicurious.com

  23. www.epicurious.com

  24. www.epicurious.com

  25. www.epicurious.com

  26. Epicurious Metadata Usage • Advantages • Creates combinations of metadata on the fly • Different metadata choices show the same information in different ways • Previews show how many recipes will result • Easy to back up • Supports several task types • ``Help me find a summer pasta,'' (ingredient type with event type), • ``How can I use an avocado in a salad?'' (ingredient type with dish type), • ``How can I bake sea-bass'' (preparation type and ingredient type)

  27. Ingredient Dish Cuisine Prepare Recipe Metadata usage in Epicurious

  28. Ingredient Dish Cuisine Prepare Select Dish Cuisine Prepare I Metadata usage in Epicurious

  29. Ingredient Dish Cuisine Prepare > Dish Cuisine Prepare Group by Metadata usage in Epicurious I

  30. Ingredient Dish Cuisine Prepare Dish Cuisine Prepare Group by Metadata usage in Epicurious > I

  31. Ingredient Dish Cuisine Prepare Dish Cuisine Prepare Group by Metadata usage in Epicurious > I Select I Cuisine Prepare

  32. Metadata Usage in Epicurious • Can choose category types in any order • But categories never more than one level deep • And can never use more than one instance of a category • Even though items may be assigned more than one of each category type • Items (recipes) are dead-ends • Don’t link to “more like this” • Not fully integrated with search

  33. Epicurious Basic Search Lacks integration with metadata

  34. The FLAMENCO PROJECTUsability Studies to determine how to improve website search Marti Hearst Rashmi Sinha Ame Elliott Jen English Kirsten Swearington Ping Yee http://bailando.sims.berkeley.edu/flamenco.html

  35. The FLAMENCO Project • Usability studies to determine how to improve site search using metadata • Researchers: • Marti Hearst, Rashmi Sinha • Ame Elliott, Jennifer English, Kirstin Swearington, Ping Yee • So far: • Epicurious usability study • Image search interface framework and study design

  36. Epicurious Usability Study • 9 participants so far • Independent Variables: • 1) Epicurious Interface (Basic vs. Enhanced vs. Browse) • 2) Task type (known-item search vs. browsing for inspiration) • 3) Degree of constraint of query • 4) Number of results required (1 vs. many) • Dependent Variables: • 1) Time to find satisfactory recipe(s) • 2) Navigation path (backtracking, starting over, revising queries) • 3) Satisfaction with results of search • 4) Satisfaction with individual system features (e.g. breadcrumbs, query previews, refine by hyperlinks) • 5) Likelihood of using each interface in the future.

  37. Epicurious Usability Study • Participants were asked to: • Do 3 pre-specified searches in advance • In the lab: • Specify a cooking scenario of interest to them • Search for 3 recipes for this recipe • Search for each recipe using each of the interfaces • Complete several structured tasks • Along the way, answer questions about • Getting closer or farther away from goal • Satisfaction with search results • Satisfaction with the interace

  38. Usability Study: Preliminary Results, Preference Data

  39. Usability StudyPreliminary Results: Feature Preference

  40. Usability StudyPreliminary Results: Quantitative

  41. Usability StudyPreliminary Results: Constraint-based Preferences

  42. Usability Study Results: Summary • People liked the browsing-style metadata-based search and found it helpful • People sometimes preferred the search-style metadata search when the task was more constrained • But zero results are frustrating • This can be alleviated with query previews • People disprefer the standard simple search

  43. Application to Image Search

  44. Image Search: What is the task? • Illustrate my slides? • “Find a crevasse” • Keyword match works pretty well • Find inspiration for an architectural design? • Needs richer search support

  45. Faceted Metadata Image: Architect: Period: Location: Concept: Planalto Palace Parti Communiste Francais Pantheon Oscar Neimeyer Oscar Neimeyer Jacques-Gabriel Soufflot 20th Century 20th Century 17th & 18th C. Brasilia Paris Paris Stone Curvilinear Stone

  46. Faceted Metadata Image: Architect: Period: Location: Concept: Planalto Palace Parti Communiste Francais Pantheon Oscar Neimeyer Oscar Neimeyer Jaques-Gabriel Soufflot 20th Century 20th Century 17th & 18th C. Brasilia Paris Paris Stone Curvilinear Stone

More Related