1 / 22

Assessment for the Rest of Us: Informal Techniques You Can Use

Assessment for the Rest of Us: Informal Techniques You Can Use . Program Co-chairs: Jeanne Brown, Assessment Librarian, University of Nevada, Las Vegas Jan Lewis, Associate Director, East Carolina University.

rowa
Download Presentation

Assessment for the Rest of Us: Informal Techniques You Can Use

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Assessment for the Rest of Us: Informal Techniques You Can Use Program Co-chairs: Jeanne Brown, Assessment Librarian, University of Nevada, Las Vegas Jan Lewis, Associate Director, East Carolina University Sponsored by the LLAMA Measurement, Assessment & Evaluation Section, Data Collection for Library Managers Committee LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us

  2. Our Student Scholars Said What??? A 12-Question survey followed by an informal focus group luncheon were fairly easy techniques for discerning what a group of undergraduate student scholars know and think about the library. Oklahoma State University Karen Neurohr, Associate Professor, Assessment Librarian Jennifer Paustenbaugh, Ph.D., Associate Dean for Planning and Assessment LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us

  3. Student Scholars and the Library • Oklahoma State University- Land-grant; ARL Library, serving 22,845 students • Assessment activity: Survey and Informal Focus Group • Population: Undergraduate research scholars • Time Commitment: 4 hours • Findings: Several interesting discrepancies between survey results and comments LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us

  4. Let them try it before you buy it Conducting demonstrations and trials can help libraries get the biggest bang for their buck.  Students test, evaluate, and recommend products and libraries make informed purchases. Louise L. Lowe, Assistant ProfessorPublic Services Librarian Judith D. Brook, Associate ProfessorAssociate Dean of University Libraries and Director Mercer University, Atlanta LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us

  5. Let them try it before you buy it Who we are… • Mercer University, Atlanta Campus • Approximately 2,500 graduate and professional students • Approximately 4,000 library visitors per week What we did… • Conducted trials or demonstrations; allowed 1 - 2 weeks for feedback • Tested equipment like netbooks, adjustable monitors and keyboards, etc. • Taste test for new coffee vending What we learned… • ‘Good value’ is important to student • Students are willing to make compromises • Students want to be involved LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us

  6. Unobtrusive User Observation as Assessment Technique: What are Students Doing in the Library After Hours Kornelia Tancheva, Director of John M. Olin Library and Uris Library, Cornell University Study of User Behavior in Uris Library, open 24/7 LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us

  7. Student Behavior in the Library After Hours • Cornell U Library; Uris: former “undergraduate library” • Unobtrusive observation • Survey population: undergraduate students • Moderate Time Commitment • Findings: use of spaces, use of technology; service requirements LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us

  8. Why Isn’t Our Chat Reference Service Used More Often? Sharon Naylor and Bruce StoffelEducation Librarian and Reference Coordinator Illinois State University Exploring patron attitudes and behavior through focus groups LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us

  9. Why Isn’t Our Chat Reference Service Used More Often? Who we are... • 21,184 students (87% undergraduates) • 1.6 million volumes, 43,000 annual patron transactions What we did... • Conducted 7 focus groups, August-December 2005 • Involved 45 sophomores, juniors, seniors • Each group discussion lasted about 90 minutes What we learned... • Desire for reference services that are personalized • Support for a variety of reference venues not just IM/chat • Preference for familiar, reliable technology LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us

  10. The CalArts’ Student Behaviors and Habits (CASBAH) Project Jeff Gatten, Dean of Library and Information Resources at California Institute of the Arts Poster surveys were used to generate a wealth of instant and practical feedback with minimal effort. LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us

  11. The CalArts’ Student Behaviors and Habits (CASBAH) Project • Arts college (BFA, MFA, DMA) • 1,399 Students • 60% undergrad. & 40% grad. • 51% female & 49% male • Poster surveys in the Library • 3-4 hours to compile & organize data • Findings: Most desired = easy changes to environment LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us

  12. Challenging Assumptions: Chatting with Patrons Rachel Besara, Assessment Librarian Kirsten Kinsley, Assessment Librarian Florida State University Libraries The information gathered challenged many of the assumptions held about undergraduate students. LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us

  13. Challenging Assumptions: Chatting with Patrons • Florida State University (Carnegie Foundation Rated Doctoral/Research Extensive University) • Short Survey/Interviews • 167 Undergraduate Students on & off campus • One Month • Discovered nuanced student study habits LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us

  14. Assessing Community Usersin an Academic Library Wanda V. Dole, Dean Ottenheimer Library, University of Arkansas at Little Rock J. B. Hill, Director of Public Services Ottenheimer Library, University of Arkansas at Little Rock The Ottenheimer Library recently conducted a quantitative/qualitative assessment of its unaffiliated library users. LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us

  15. Assessing Community Users • University of Arkansas at Little Rock • Metropolitan university with 13,000 students • Carnegie Research Extensive University • Quantitative Data • Analysis of Millennium and Uniprint patron records • Qualitative Data • Survey of unaffiliated library users registered for circulation of Internet privileges • Limited Time Commitment - ~80 hours • Findings • Two distinct user populations – behaviors & needs • Casual affiliations with university • Privileges created good will toward university • Result in review of unaffiliated user policies/services LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us

  16. “Flip” the Library AmeetDoshi User Engagement Librarian and Assessment Coordinator Georgia Institute of Technology Library Video Assessment at Georgia Tech Library LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us

  17. Flip Camera Assessment: Fast, Cheap, Easy • Georgia Tech Student Culture: Hands-on, interactive • LibQUAL 2010: 88% of Undergrads use facility regularly • Video Assessment of Library Facility • Student Library Advisory Board • 1 hour (prep/shooting/recap) and 2-4 hours editing • Useful to… • View experience from user perspective • Assess completed or discuss proposed renovations • Discover emerging problems • Web usability LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us

  18. LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us

  19. MIT Libraries’ Book(cart)mobile: Assessing its Value Lisa R. Horowitz, Assessment Librarian, Massachusetts Institute of Technology The MIT Libraries’ Humanities and Music Libraries surveyed users and staff to determine if the benefits of undertaking a monthly bookmobile outweighed its staffing costs. LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us

  20. MIT Libraries’ Book(cart)mobile • MIT: 10,000 students; 10,000 faculty and staff • Five main libraries – Bookmobile is specific to Humanities and its branch, Music • Two survey instruments: user survey and staff interviews • Data gathered over two and half months, March to May 2009 LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us

  21. Observation and Mapping Kathy Ray University Librarian American University of Sharjah Observing student behavior helped us achieve a better balance between high and low use study spaces LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us

  22. Observation and Mapping • AUS – 5,000 students primarily undergrad • Coed environment new for majority • Incredibly active/high traffic zone in the middle of preferred high use study space • Observations over 5 week period • 30 minutes 3 times per week • Reconfigured mix of carrels, tables, browsing collections & displays for better balance of quiet and active zones LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us

More Related