1 / 37

Library Quality Assessment

Library Quality Assessment. NCES Summer Data Conference July 25, 2002. Martha Kyrillidou, Julia Blixrud, Consuella Askew Waller. Project web site www.arl.org/libqual/. Opportunities and Pressures.

thadd
Download Presentation

Library Quality Assessment

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Library Quality Assessment NCES Summer Data Conference July 25, 2002 Martha Kyrillidou, Julia Blixrud, Consuella Askew Waller Project web site www.arl.org/libqual/

  2. Opportunities and Pressures • Increasing demand for libraries to demonstrate outcomes/impacts in areas of importance to institution • Increasing pressure to maximize use of resources through benchmarking resulting in: • Cost savings • Reallocation

  3. Antecedents • Effective service delivery • “every unit … is valued in proportion to its contribution to the quality success of the campus” Danuta Nitecki

  4. Why New Measures • Increased customer and stakeholder expectations • Greater demands for accountability • Exploding growth in use and applications of technology • Increasing competition for resources • Need for reliable and valid data • Benchmarking and best practice • Trends over time

  5. ARL New Measures Initiative • Collaboration among member leaders with strong interest in this area • Specific projects developed with different models for exploration • Projects self-funded by interested members • Intent to make resulting tools and methodologies available to full membership and wider community • Freeze modifications to existing descriptive measures

  6. LibQUAL+™ Description • LibQUAL+TM is a research and development project undertaken to define and measure library service quality across institutions and to create useful quality-assessment tools for local planning.

  7. The Purpose of the Research • To fill a knowledge void in modeling the dimensions of library service quality from a user perspective • Based upon the model, to develop a web-delivered, effective total market survey instrument equivalent for service quality assessment in academic libraries • Using the derived instrument to recommend a process for an ongoing program of comparative outcome measurement for academic libraries

  8. Project Resources • LibQUAL+TM is an ARL/Texas A&M University joint effort. The project is supported in part by a 3-year grant from the U.S. Department of Education’s Fund for the Improvement of Post-Secondary Education (FIPSE).

  9. Relationships: Perceptions, Service Quality and Satisfaction ….only customers judge quality; all other judgments are essentially irrelevant” Zeithaml, Parasuraman, Berry. (1999). Delivering quality service. NY: The Free Press.

  10. LibQUAL+™ Project Goals • Establishment of a library service quality assessment program at ARL • Development of web-based tools for assessing library service quality • Development of mechanisms and protocols for evaluating libraries • Identification of best practices in providing library service

  11. Process Overview

  12. Dimensions of Library Service Quality

  13. Spring 2000 (41-Item Survey) Spring 2001 (56-Item Survey) Spring 2002 (25-Item Survey) Affect of Service Affect of Service Service Affect Reliability Library as Place Library as Place Library as Place Reliability Personal Control Provision of Physical Collections Self Reliance Information Access Access to Information Access to Information Survey Dimensions

  14. LibQUAL+TM Participants Year 3 Year 2 164 Participants 43 Participants Year 1 12 Participants Spring 2002 Spring 2000 Spring 2001

  15. Process Timeline June/July 2002 August 2002 September 2002 October – December 2002 • Gather information about LibQUAL+TM survey • Determine if have appropriate resources • Identify budgetary requirements if any • Register for Spring 2003 survey • Subscribe to ARL-QUALITY listserv • Designate survey liaison/committee/project team • Register for LibQUAL+TM related workshops • Identify and initiate steps to obtain human subjects research approval from IRB • Identify sample groups • Identify best data source to obtain valid e-mail addresses for sample groups • Meet with person(s) who will be drawing e-mail addresses to determine process feasibility • Register for LibQUAL+TM related workshops

  16. Process Timeline January 2003 February 2003 March-April 2003 May 2003 June 2003 July 2003 • Need to have IRB approval by mid-January • January 27-28, orientation session for participating libraries held during ALA Midwinter, Phildelphia, PA Attendance is required! • Complete online demographics questionnaire • Preview survey turned on • Draw final e-mail address samples • Spring 2003 survey open to public. • Send out survey announcements • Spring 2003 survey closed to public • Participants complete online post hoc survey • Survey results distributed • LibQUAL+TM evaluation questionnaire sent to participants

  17. Sample Survey

  18. Sample Survey…continued

  19. Sample Survey…continued

  20. Sample Survey…continued

  21. Sample Survey…continued

  22. Sample Survey…continued

  23. Sample Survey…continued

  24. Project Deliverables • Print and web-based results include: • Aggregate Summaries • Demographics by Library • Item Summaries • Dimension Summaries • A copy of the survey instrument • Dimensions measured for survey implementation

  25. Surveys Completed Spring 2002

  26. LibQUAL+ Assessment Survey Aggregate (All Ranks) (All) Aggregate (All Ranks) Texas A&M University

  27. Interpretation Frameworks • Zone of tolerance • Score norms

  28. Technology Approach • Reduced HTML requirements • 2 load-balanced web/application server connected to 1 database • Software use: ColdFusion, IIS webserver, SQL server, and Windows Advanced Server 2000

  29. The Future: LibQUAL+

  30. LibQUAL+ TM Brief History • Experience with SERVQUAL in many libraries over the last 15 years • Texas A&M SERVQUAL assessment • New Measures Initiative called a meeting of interested ARL libraries (ALA Midwinter 2000) • External funding through FIPSE, U.S. Department of Education (September 2000) • Consortia and related associations participation • Expressed interest by another 150 institutions for spring 2003 • International Interest • Other sectors outside higher education

  31. Emergence of Consensus • Antecedents • Credibility • Collaboration • Tangibility • Dissemination • Evaluation • External Validation • Looking Forward: Maintenance of Consensus

  32. Maintenance of Consensus • Balance central control with local autonomy • Issues of confidentiality/anonymity vs. desires for longitudinal study • Normative issues/Best practices vs. “ranking” • Long-term sustainability

  33. Additional Information Visit the LibQUAL+TM Web Page: old.libqual.org

More Related