Florida’s Outcome-Based Evaluation Program

1. Florida’s Outcome-Based Evaluation Program Finding the Fit with Multitype Library Cooperatives Sondra Taylor-Furbee June 15, 2002

2. LSTA and Outcomes • 1998 Florida participated in first IMLS pilot project to begin looking at outcomes • Revisited our sub-grant program

3. LSTA Grants • Application must be developed with anticipated outcomes • Annual and mid-year reports address outcomes • Outcomes are stated in terms of the benefit to customer

4. Traditional Project Measurement:

5. Outcomes Measurement

6. Categories for LSTA Grants • Access for Persons Having Difficulty Using Libraries • Library Technology Connectivity and Services

7. Sample Common Outcomes • Public uses technology to get information • Public learns to use technology

8. Eligible Types of Libraries • Public Libraries • Academic Libraries • Special Libraries • School Libraries • Multitype Library Cooperatives

9. Central Florida Library Cooperative • Northeast Florida Library Information Network • Panhandle Library Access Network • Southeast Florida Library Information Network • Southwest Florida Library Network • Tampa Bay Library Consortium

11. MLC Membership • Total Membership: 358 Libraries • 121 Academic • 106 Public • 87 Special • 44 School

12. Operating Incomeby Source • Local 39% • State 23% • Federal 38%

14. LSTA Grant from CFLC:Technology Training for Central Florida Libraries • Purpose: Provide technology training to the staff of member libraries to assist in service to the public.

15. Activities • Hire Continuing Education Coordinator • Develop and update curriculum • Schedule workshops • Develop offsite training facilities • Conduct workshops

16. Outcomes: • Library staff is able to use technology to assist patrons to obtain information • Library staff is able to use technology to assist patrons in operating computers

17. Indicators: • 75% staff attending workshops increase technology knowledge and comfort level of working with patrons

18. Evaluation • Sample outputs • Number of classes • Number of participants • For outcome: • Training workshop evaluations • Trainer observation • Follow up survey

19. Midyear Report: • Developed 2 new workshops • More training opportunities • Developed trainers observation checklist • Developing follow-up survey • Developing automated evaluations for classes

21. TBLC Anytime Anywhere Library • Brings together resources of Tampa Bay libraries for access by anyone, at anytime, from anywhere, via the Internet. • Pilot regional virtual library including ILL. • http://alleycat.tblc.org/

22. Outcomes • Public uses technology to get information • Participants learn to use technology

23. Activities • Create virtual library umbrella web site for use by the public • Expand pilot regional virtual catalog and ILL system • Enable customers of participating library to request materials • Implement remote authentication for customers

24. Evaluation • Outputs • # hits on Alleycat website • # requests for ILL • # training sessions • # content links • Outcome Source Methods: • Email survey to Alleycat users • Training Class evaluation forms

25. NEFLIN • Digital Imaging of Special Collections • Local history collections from Alachua County,Putnam County, and Jacksonville University • User surveys

26. PLAN • Plan Academy - Technology Training • Evaluation forms • Post training surveys • Anecdotal report

27. SEFLIN • Has LSTA grant applications online - can see LSTA outcome model http://www.seflin.org/ • Mi Servicio de Biblioteca • Access to library services for Spanish-speaking population • Online survey

28. SWFLN • Technology Training • Workshop evaluations • Postcard survey

29. Benefits • Cooperatives have impacts can report to members, potential members, funders • State Library can aggregate changes MLCs have made in Florida

30. MLC web sites • CFLC http://cflc.net/ • NEFLIN http://www.neflin.org/ • PLAN http://plan.lib.fl.us/ • SEFLIN http://www.seflin.org/ • SWFLN http://www.swfln.org/ • TBLC http://www.tblc.lib.org/