Research in the library an evidence based approach for making informed decisions
Download
1 / 27

Research in the Library: An Evidence-based Approach for Making Informed Decisions - PowerPoint PPT Presentation


  • 136 Views
  • Uploaded on

Research in the Library: An Evidence-based Approach for Making Informed Decisions. Library Research Seminar-V Session 3B, Room 1105 Thursday, October 7, 2010. The process of implementing a federated search system at the National Institutes of Health Library.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Research in the Library: An Evidence-based Approach for Making Informed Decisions' - erno


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Research in the library an evidence based approach for making informed decisions

Research in the Library: An Evidence-based Approach for Making Informed Decisions

Library Research Seminar-V

Session 3B, Room 1105

Thursday, October 7, 2010


The process of implementing a federated search system at the national institutes of health library
The process of implementing a federated search system at the National Institutes of Health Library

Anne White-Olson, Information & Education Services Branch

Ben Hope, NIHL Information Architecture Branch

Douglas Joubert, NIHL Information Architecture Branch

DIVISION OF LIBRARY SERVICESOFFICE OF RESEARCH SERVICESNATIONAL INSTITUTES OF HEALTHU.S. DEPARTMENT OF HEALTH AND HUMAN SERVICES


Project goals and objectives
Project Goals and Objectives National Institutes of Health Library

  • Find a meta-search product that would allow NIH staff to simultaneously search multiple resources

  • Establish a search interface that integrates library resources into the NIH Clinical Research Information Systems (CRIS)

  • Ascertain the needs and preferences of NIH staff in terms of searching for information online

  • Identify core functionality and ideal user interface design for the NIHL meta-search tool


One search system deployed on 2 unique platforms
One search system deployed on 2 unique platforms National Institutes of Health Library

  • Clinical Center*

  • NIH Library

The Clinical Center search interfaces exposes patient data; therefore,

we are not able to show search results


About the search prototype
About the search prototype National Institutes of Health Library

  • Developed by Tamas Doszkocs, Senior Computer Scientist at NLM.

  • Searches multiple, independent databases and clusters retrieval into subject categories.

  • Utilizes natural language process tools to access heterogeneous information sources on the open and deep web.

  • Includes spellchecker, automatic mapping to thesauri, concept clusters for focused drill down and query refinement.


The environment nih library 2006
The Environment - NIH Library 2006 National Institutes of Health Library

Two things were happening

  • Professional staff was taking a Qualitative Research Course

  • Staff was looking into implementing a Federated Search System

Outcomes

  • Combined the two to develop a class project on looking at systems using qualitative research methods learned in class.

  • In 2009 completing the process implementing First Search at the NIHL


Project phases
Project Phases National Institutes of Health Library

Phase 1

Phase2

The NIHL contracted with UserWorks, Inc. to conduct a usability study.

A qualitative approach using focus groups with six nurse specialists from the Department of Clinical Research Informatics was used.


Grounded theory
Grounded Theory National Institutes of Health Library

  • Inductively build theories through successive levels of data analysis and conceptual development.

  • The theory evolves and changes as the researcher interacts with the data.

  • Methodology is inductive rather than deductive due to the “interplay with the data collected in actual research”.

  • Interplay is continuous and evolving

Berg, B. L. (2007). Qualitative research methods for the social sciences (6th ed.). Boston: Pearson/Allyn & Bacon.


Our focus group

CRIS Nurse Informaticians who provide user support, training and documentation for the NIH Clinical Research Information System

Our Focus Group


Focus group methods 1
Focus Group Methods (1) training and documentation for the NIH Clinical Research Information System

Participants were asked the following questions

What is your favorite web site and why?

When you search for information on the web, where do you go?

What resources do you use at the library?


Focus group methods 2
Focus Group Methods (2) training and documentation for the NIH Clinical Research Information System

The contents of interviews were transcribed and analyzed in ATLAS.ti according to the principles of grounded theory.

  • Focus group activities included a discussion of meta-searching and a demonstration of the meta-search prototype.

  • Additional discussion to elicit feedback from the participants concerning the preferred design and features of a meta-search search system.


Focus group methods 3
Focus Group Methods (3) training and documentation for the NIH Clinical Research Information System

  • Focus group transcripts were loaded into ATLAS.ti v5.2.12 for analysis.

  • Content analysis is the systematic examination and interpretation of a primary document to identify themes and meanings.


Focus group methods 4
Focus Group Methods (4) training and documentation for the NIH Clinical Research Information System

  • Independent group also developed codes using index cards.

  • After the first and second stages of organizing the codes into themes, a third researcher was brought in to resolve differences in organizing the codes into groups.


Usability methods 1
Usability Methods (1) training and documentation for the NIH Clinical Research Information System

  • The usability study compared the prototype to a number of meta-search platforms in an attempt to understand user performance, needs, and preferences of the proposed meta-search platform.

  • The usability study had 14 participants (4 male and 10 female), which included researchers, administrators, and NIHL staff.


Usability methods 2
Usability Methods (2) training and documentation for the NIH Clinical Research Information System

  • Each subject participated in a one-on-one interview and three user-performed tasks:

  • Find information on a specific topic

  • Locate a specific article

  • If time allowed, conduct a user-defined search


Results focus group
Results – Focus Group training and documentation for the NIH Clinical Research Information System

88 codes were generated from 114 quotations using the open coding technique, in which research team members grouped each line of discreet and meaningful text from the focus group transcript into conceptual units.

  • The “Features” theme focused on the manipulation of search results and saving searches

  • “Types of Resources” theme focused on the resources commonly used by these focus group participants, namely PubMed and CINAHL


16 themes generated from the codes
16 themes generated from the codes training and documentation for the NIH Clinical Research Information System


Usability grouped categories
Usability Grouped Categories training and documentation for the NIH Clinical Research Information System

Advanced search

Search terms

Search status and results

Refining results

Clustering

Search Results Display

Other Key Findings


Advanced search
Advanced search training and documentation for the NIH Clinical Research Information System

  • It was important to have an advanced search option to accommodate different users

  • Labels need to be clearly identified and use intuitive nomenclature (no library jargon)

  • Help needs be context-specific.


Search terms
Search terms training and documentation for the NIH Clinical Research Information System

  • Increase the prominence of the “did you mean” spell check

  • Employ commonly used search inputs, such as quotation marks, the word “and,” semi-colons, and the plus sign


Search status and results
Search status and results training and documentation for the NIH Clinical Research Information System

  • Wanted a status bar to help them understand when the search was complete.

  • Preferred to wait and see all the results at once, rather than seeing the results by source.


Refining results
Refining results training and documentation for the NIH Clinical Research Information System

  • Used and liked the refine results option

  • Function of “refine results” was not consistent across all platforms


Search results display
Search results display training and documentation for the NIH Clinical Research Information System

  • Participants expected and wanted a summary abstract for journal articles

  • Participants wanted keywords in titles and abstract to be highlighted to determine whether a result was relevant


Clustering
Clustering training and documentation for the NIH Clinical Research Information System

  • Participants thought that clustering was important; however, it needed to be refined:

    • Offer many layers to the clustering

    • Show consistent clusters

    • Show full subcategory cluster headings

    • Provide a means for narrowing by clustering without losing the primary cluster


Other key findings
Other Key Findings training and documentation for the NIH Clinical Research Information System

  • Right-handed content had limited use and interest

  • Several features were not heavily utilized

    • Category links

    • MeSH capability

    • Publication links

    • Sort and limit options


Ok what next
OK, What Next? training and documentation for the NIH Clinical Research Information System

  • Based on the findings from the usability study, the team developed a list of priorities for the developer

  • The list was further refined for both products


Contact us
Contact Us training and documentation for the NIH Clinical Research Information System

  • Douglas J. Joubert, MS, MLISNational Institutes of Health LibraryPhone: 301-594-6282E-mail: joubertd@mail.nih.govLinkedIn: http://www.linkedin.com/in/douglasjoubertTwitter: http://twitter.com/doujouDC

  • Anne White-Olson, MLSNational Institutes of Health LibraryPhone: 301-451-5863E-mail: whiteols@mail.nih.gov