Impact as a process: considering the reach of resources from the start

1. Impact as a process: considering the reach of resources from the start Eric T. Meyer & Kathryn Eccles Oxford Internet Institute, University of Oxford Digital Humanities@Oxford Summer School 8th July 2013 @etmeyer @KathrynEccles #tidsr #dhoxss Slides at:

2. What is impact and why consider it? • What do we mean by impact? • Reaching intended audience • Reaching new audiences • Attracting users • Attracting new usage • Enabling new research questions • Enabling new approaches to education

3. What’s the point? • Gather data for investors and stakeholders • Use your impact in future funding applications • Know that you’re reaching your audience • Be iterative and adapt • Develop and extend your resource • Ensure you’re a relevant part of the community

4. Where to begin? • Identify your audience and key stakeholders • Set your goals. What types of impact do you envisage your resource having? • What steps are you taking to ensure these types of impact? • Identify connections • What resources do you see as successful in terms of audience and impact? • Do you see your resource as part of a network of connected resources?

5. Measuring usage and impact What could you measure? • Users • Types of use • Awareness • Citation practices • Marketing strategies • Embedding

6. Methods Quantitative methods • Webometrics • Web Analytics • Log file analysis • Scientometrics / bibliometrics • Content Analysis Qualitative methods • Interviews • Focus groups • User feedback • Referrer analysis • Content Analysis

7. New methods Data collection: • Social media • Twitter • Facebook • Podcasting • YouTube/Vimeo Data management: • Visualisation

8. Digitisation and Impact

9. TIDSR: The first usage and impact study • JISC funded project • July 2008-April 2009 • Looked at five specific JISC-funded resources • Designed to test the TIDSR methods and review them for the TIDSR toolkit

10. TIDSR case studies

11. Project 1 – Online Historical Population Reports (OHPR/Histpop)

12. Survey: Low Awareness

13. Survey: High Importance to Users

14. Log Files: Non UK Activity

15. Log File Analysis • Top Search Phrases: Histpop

16. Histpop: User Communities • Perception: Specific niche community • Well known by target audience • Transforming access and usage patterns • User surveys: • Embedded in educational resources • Enhanced access to primary sources • ‘Histpop made it possible to do a completely different project’ • Continuing education, online resources, non-traditional learners

17. Project 2 – British Library 19th Century Newspapers

18. Project 2 – British Library 19th Century Newspapers

19. Citation Habits Have you ever published a piece based on your work in this collection? If so, how did you cite the collection?

20. Blog Evidence

21. Project 3 – British Library Archival Sound Recordings

22. Interviews, Group Interviews, Focus Groups • Time intensive, but productive if you are careful about what you ask! • Different stakeholders: • Project team: Positive view of the work only • Broader stakeholders: While the digital project was good, it also introduced tensions in the broader setting of the library • New kinds of serendipity, wide range of users

23. News Engagement officer

24. Project 4 – British Official Publications Collaborative Reader Information Service (BOPCRIS): 18th Century Official Parliamentary Publications Portal 1688-1834

25. Project 4 – British Official Publications Collaborative Reader Information Service (BOPCRIS): 18th Century Official Parliamentary Publications Portal 1688-1834

26. Project 5 – Wellcome Medical Journals: the backfiles project

27. Project 5 – Wellcome Medical Journals: the backfiles project

28. Knowing the Users • Historians? (would be looking at older articles) • Not typical PubMed users • Search interface issues / limited search • Clinicians? (would be looking at newer articles) • Not typically reading 100 year old articles • Other users? • Paths of discovery?

29. New uses? • Majority of downloads targeted more recent material – opening up of new resources to clinicians • More thorough and comprehensive searches • Historians reported more comprehensive search results (quantitative results) • Also reported increased browsing, greater serendipity, due to time saved finding articles

30. Awareness of Resource by Country

31. How did you find this resource?

32. http://microsites.oii.ox.ac.uk/tidsr/

33. http://simon-tanner.blogspot.co.uk/2012/10/ the-balanced-value-impact-model.html

35. University of Oxford Podcasts

36. Proceedings of the Old Bailey Online

37. British History Online

39. Siobhan Davies RePlay

40. Quick impact • If you don’t have a lot of time or resources: • Twitter • Use it for quick polls • Put out news and look at your impact • Bitly links will give you click through data • User data • Keep in touch with your users • Use them to ensure you’re meeting their needs

41. http://www.rin.ac.uk/humanities-case-studies Bulger, M., Meyer, E.T., de la Flor, G., Terras, M., Wyatt, S., Jirotka, M., Eccles, K., Madsen, C.

42. The Case Studies

43. Browsing and Searching Libraries Journals Peers

44. “ It’s a huge change. You can do things much more quickly, read much more widely, find connections…it’s very, very important.

45. “ What might take you several months if not years of research, you could do in hours, days, a week. So I think that means that it makes the nature of your research different because it allows you quantitative information much more quickly, which then allows you to maybe think about how you might use that information differently,because you’ve got so much more time.

46. Eric T. Meyer eric.meyer@oii.ox.ac.ukhttp://www.oii.ox.ac.uk/people/?id=120 Kathryn Eccles kathryn.eccles@oii.ox.ac.ukhttp://www.oii.ox.ac.uk/people/?id=138 Oxford e-Social Science Project Project work funded by:

47. Possible discussion topics • Discoverability • of what? • by whom? • by what means? (manual, automatic, guided, etc.) • Citation habits and the link to impact • Community engagement • Engaging atypical communities • Enabling unexpected uses • Having the resources to measure your resources • Impact ‘agenda’ versus increasing one’s impact