Measuring the effectiveness of facets in the next gen opac 2008 library assessment conference
This presentation is the property of its rightful owner.
Sponsored Links
1 / 24

Measuring the Effectiveness of Facets in the Next Gen OPAC 2008 Library Assessment Conference PowerPoint PPT Presentation


  • 101 Views
  • Uploaded on
  • Presentation posted in: General

Measuring the Effectiveness of Facets in the Next Gen OPAC 2008 Library Assessment Conference. Kathleen Bauer and Alice Peterson-Hart Yale University Library Usability and Assessment. Usability process. Assess current behavior Conduct usability protocol testing Share findings with staff

Download Presentation

Measuring the Effectiveness of Facets in the Next Gen OPAC 2008 Library Assessment Conference

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Measuring the effectiveness of facets in the next gen opac 2008 library assessment conference

Measuring the Effectiveness of Facets in the Next Gen OPAC2008 Library Assessment Conference

Kathleen Bauer and Alice Peterson-Hart

Yale University Library Usability and Assessment


Usability process

Usability process

  • Assess current behavior

  • Conduct usability protocol testing

  • Share findings with staff

  • Implement changes and assess effect


Assess current behavior

Assess current behavior

Collecting evidence from Yale’s Voyager-based catalog, called Orbis, using log file data.


Log file line

Log file line

12/2/07 20:0620071202200646Title IndexTALL JOHN DOGGET JNR0


Log file sample descriptive data

Log file sample descriptive data

5

Most common search: title (41.8%) followed by keyword (31.4%)

Average search phrase is 2.5 words long

Most common phrase searched is united states

Most common number of hits: 0 (21.4% )


Examples of title searches

Examples of title searches

  • BOOKS ON PHOTOGRAPHY?

  • ALABAMA 2004?

  • PATHOPHYSIOLOGY CHILDREN?

  • JOHNSON, JAMES?

  • INTRODUCTION TO AFRICAN AMERICAN STUDIES: A READER?

Topic

Name

Close


Why do title searches get 0 hits

Why do title searches get 0 hits?


Decreasing search types 2007 2008

Decreasing search types 2007-2008


Some conclusions from log analysis

Some conclusions from log analysis

  • Patrons commonly use field specific searches unsuccessfully

  • Majority of searches don’t use catalog metadata beyond title (decreasing)

  • Errors happen a variety of ways and

    current Voyager system is not helpful in avoiding those errors


Next gen opac vufind

Next Gen OPAC -- Vufind


Conduct usability tests

Conduct usability tests

After deciding to implement Vufind, use data from log files to help design usability tests


Creating usability tests for yufind

Creating usability tests for Yufind

  • Two opportunities for tests:

    • medical implementation of subject-based ebooks display

    • alternative interface for catalog (aimed at undergraduates)

  • Objective: Would the participant see and choose facets? (more than 26% of the time)

  • Objective: Would the participant use facets successfully?


Questions

Questions

  • Find books within a set by a particular author (John Adams).

  • In a set of books about healthcare, find some that are about healthcare reform.

  • Within a subject-based display of ebooks find a topic-based subset.


Facets key findings

Facets: key findings

  • Were seen and sometimes used but

  • not always successfully for author and topic

    • Subsets sometimes didn’t make sense

    • Hard to navigate (not alphabetical)

  • Little use of call number facet

  • Some preferred search refinement to facets

  • Participants noted potential usefulness: format, language, and topic facets


Did facets increase metadata use

Did facets increase metadata use?

YES


Share findings with staff

Share findings with staff

Staff need to engage with findings of usability testing and current behavior in Orbis to decide best practices and to build empathy for user experience.


Relevance ranking and facets

Relevance ranking and facets


Review keyword searches with subject specialist librarians

Review keyword searches with subject specialist librarians

  • Times square red times square blue

  • hague conference on peace hague conference on peace 1907second hague conference on peace 2nd hague conference on peace

  • cuban revolution cuban revolution of 1959

  • … (list of 50 to start)


Set best practices for facet display

Set best practices for facet display

  • Display facets on left

  • Develop consistent terminology between different applications

  • Consistent order of display


Implement changes and assess

Implement changes and assess


Implement changes and assess1

Implement changes and assess

  • Move facets to the left side (standard)

  • Demoted (in list order) topic facet

  • Add a sort option—will that increase successful use of facets?

  • Can we promote use of call number facets?


Usability process1

Usability process

  • Assess of current behavior

  • Conduct usability protocol tests

  • Share findings with staff

  • Implement changes and assess effect


Slides and findings available

Slides and findings available

http://www.library.yale.edu/libepub/usability/yulstudies.html/arl.ppt

Yale University Library Usability and Assessment Department

Kathleen Bauer

Alice Peterson-Hart

Send questions to [email protected]


  • Login