Improving Graduate Education with Digital Libraries

1. Improving Graduate Education with Digital Libraries Eröffnung des DFG-Graduiertenkollegs 1223 “Qualitätsverbesserung im E-Learning durch rückgekoppelte Prozesse” Darmstadt, GE, September 14, 2006 Edward A. Fox fox@vt.edu http://fox.cs.vt.edu

2. Outline • Acknowledgements • ETDs and NDLTD • DL curriculum and resource development • Prior work on quality and success models • DL success model • From end user perspective • Summary and Conclusions

3. Acknowledgements (selected) • Colleagues: Lillian Cassel, Debra Dudley, Weiguo Fan, Marcos Gonçalves, Doug Gorton, Rohit Kelapure, Neill Kipp, Aaron Krowne, Ming Luo, Uma Murthy, Manuel Perez, Ananth Raghavan, Rao Shen, Hussein Suleman, Srinivas Vemuri, Layne Watson, … • Sponsors: ACM, AOL, CAPES, DFG, IBM, Microsoft, NSF (IIS-9986089, 0086227, 0080748, 0325579, 0535057, 0535060; ITR-0325579; DUE-0121679, 0136690, 0121741, 0333601), SUN, …

4. Acknowledgements: ETD Mtgs • 1987 mtg in Ann Arbor: UMI, VT, … • 1992 mtg in Washington: CNI, CGS, UMI, VT and 10 universities with 3 reps each • 1993 mtg in Atlanta to start Monticello Electronic Library (regional, US Southeast): SURA, SOLINET • 1994 mtg at VT: std: PDF + SGML + multimedia objects • 1996 funding by SURA, US Dept. of Education (FIPSE) • 1997 meetings in UK, Germany, ... • 1998 – 1st symposium – Memphis (20) • 1999 – 2nd symposium – Blacksburg (70) • 2000 – 3rd symposium – St. Petersburg (225) • 2001 – 4th symposium – Caltech (200) • 2002 – 5th syposium – BYU, Provo, Utah • 2003 – 6th syposium – Berlin (215) • 2004 – 7th syposium – U. Kentucky • 2005 – 8th syposium – Sydney, Australia

5. Acknowledgements:Future ETD Conferences • 2007 – 10th symposium • Uppsala University, Sweden • 13-16 June • 2008 – 11th symposium • Dartington College of Arts, Devon, UK • 29 June – 2 July (tentative)

6. Outline • Acknowledgements • ETDs and NDLTD • DL curriculum and resource development • Prior work on quality and success models • DL success model • From end user perspective • Summary and Conclusions

7. The Networked Digital Library of Theses and Dissertations www.NDLTD.org Training Authors Expanding Access Preserving Knowledge Improving Graduate Education Enhancing Scholarly Communication Empowering Students & Universities Leader of the Worldwide ETD (Electronic Thesis and Dissertation) Initiative

9. NDLTD Incorporation • Networked Digital Library of Theses and Dissertations incorporated May 20, 2003 in Virginia, USA • Charitable and educational purposes (501 c 3) • Officers • Executive Director (Ed Fox) • Secretary (Gail McMillan) • Treasurer (Scott Eldredge)

10. Suzie Allard (ETD 2004, U. Kentucky) Denise A. D. Bedford (World Bank) Julia C. Blixrud (ARL, SPARC) José Luis Borbinha (Natl Lib Portugal) Tony Cargnelutti (Ex Libris) Vinod Chachra (VTLS) William Clark (Ohio State U.) Susan Copeland (RGU, UK) Jude Edminster (Bowling Green St. U.) Scott Eldredge (Treasurer, ETD 2002, BYU) Edward A. Fox (Exec Director,Virginia Tech) John H. Hagen (West Virginia U.) Thomas B. Hickey (OCLC) Christine Jewell (U. Waterloo, Canada) Joan K. Lippincott (CNI) Austin McLean (Proquest) Gail McMillan (Secretary, Virginia Tech) Joseph Moxley (ETD 2000, USF) Eva Müller (U. Uppsala, Sweden) Ana Pavani (PUC Rio, Brazil) Janice Rickards (chair of ADT) Sharon Reeves (National Library Canada) Peter Schirmbacher (ETD 2003, Humboldt) Samson Soong (Hong Kong U. Science & Technology) Hussein Suleman (U.Cape Town, S. Africa) Shalini R. Urs (U. Mysore, India) Eric F. Van de Velde (ETD 2001, Caltech) Ellen Wagner (Adobe) Board of Directors

11. Argentina Australia Belgium Brazil Canada Chile China, Hong Kong Columbia Finland France Germany Greece India Italy Jamaica Korea Lithuania Malaysia Mexico Namibia Netherlands Namibia Netherlands Norway Peru Poland Russia Singapore S. Africa S. Korea Spain Sudan Sweden Switzerland Taiwan Thailand Turkey UK Ukraine United Arab Emirates USA Venezuela Yugoslavia Some Countries

17. OCLC SRU Interface

21. ETD Union Search Mirror Site in China (CALIS)(http://ndltd.calis.edu.cn – popular site!)

22. Outline • Acknowledgements • ETDs and NDLTD • DL curriculum and resource development • Prior work on quality and success models • DL success model • From end user perspective • Summary and Conclusions

23. DL Curriculum Development Project • Collaborative Research launched by: - Department of Computer Science, Virginia Tech - School of Information and Library Science, University of North Carolina, Chapel Hill • Three year (2006 - 2008) funded project

24. Project Teams/NSF Grant • Project Team at VT (IIS-0535057): • PI: Dr. Edward A. Fox (fox@vt.edu) • GRA: Seungwon Yang (seungwon@vt.edu) • Project Team at UNC-CH(IIS-0535060): • Co-PI: Dr. Barbara Wildemuth (wildem@ils.unc.edu) • Co-PI: Dr. Jeffrey Pomerantz (pomerantz@unc.edu) • GRA: Sanghee Oh (shoh@email.unc.edu)

25. Development / Evaluation PlanJanuary 2006 – December 2008

26. DL Topics in 19 Modules (original)

27. Outline • Acknowledgements • ETDs and NDLTD • DL curriculum and resource development • Prior work on quality and success models • DL success model • From end user perspective • Summary and Conclusions

28. Prior Work on Measuring DL Success inspection of NCSTRL Usability of DLs has an example evaluation of ACM, IEEE-CS, NCSTRL, and NDLTD evaluation of ADL evaluation of ADEPT Intention to re/use predict Technology acceptance model has an example Venkatesh system usage DeLone et al. has an indicator IS success model has an example Seddon Ellis Information seeking behavior model has an example Kuhlthau DL quality model has an example Gonçalves

29. intention to use system performance expectancy system usage effort expectancy social influence facilitating conditions Behavioral Attitude & Intension to Use— Venkatesh Model of IT Adoption Unified Theory of Acceptance and Use of Technology

30. Venkatesh Model of IT Adoption • Performance expectancy: • perceived usefulness, extrinsic motivation, job-fit, relative advantage, and outcome expectations • Effort expectancy • the degree of ease associated with the use of system • Social influence • Subjective norms, social factors, and image • Facilitating conditions • the degree to which an individual believes that an organizational and technical infrastructure exist to support the system

31. DeLone and McLean Model of IS Success System Quality Use Individual Impact Organization Impact Information Quality User Satisfaction

32. Seddon Model of IS Success Net Benefits to: Individuals Organizations Society System Quality Perceived Usefulness Information Quality User Satisfactions

33. Outline • Acknowledgements • ETDs and NDLTD • DL curriculum and resource development • Prior work on quality and success models • DL success model • From end user perspective • Summary and Conclusions

34. DL Success Model • Synthesize • IS success and adoption models • DL quality model (Gonçalves) • Information life cycle model • Information-seeking behavior models (Ellis’ and Kuhlthau’s) • From end user perspective

35. searching, browsing, recommending accessing, filtering completeness, conformance accuracy, Active accessibility, preservability Semi-active preservability, authoring, modifying, describing organizing, indexing storing, archiving, networking similarity, timeliness, creation distribution utilization seeking pertinence, significance, relevance Gonçalves et al. accessibility, Inactive timeliness

36. E1:starting K1: initiation K6: presentation E2: chaining E3: browsing E4: differentiating E5: monitoring E6: extracting K2: selection K5: collection K3: exploration K4: formulation E: Ellis’ model K: Kuhlthau’s model completeness, conformance accuracy, Active accessibility, preservability Semi-active preservability, authoring, modifying, describing organizing, indexing storing, archiving, networking similarity, timeliness, creation distribution utilization seeking Inactive DL Success Constructs

37. relevance adequacy timeliness reliability understandability scope ease of use accessibility user interface joy of use reliability DL Success Model information quality (IQ) information quality (IQ) performance expectancy (PE) behavioral Intention to (re)use satisfaction system quality (SQ) social influence (SI)

38. collection metadata catalog digital object metadata specification repository DL Concepts Regarding Information associated with consist of consist of associated with consist of

39. Digital Library IQ digital object accessibility understandability preservability relevance pertinence timeliness relevance reliability similarity adequacy significance timeliness metadata specification accuracy completeness conformance collection completeness impact factor completeness catalog consistency completeness repository consistency Information Quality (IQ) digital object metadata specification catalog collection adequacy repository scope

40. relevance adequacy timeliness reliability understandability scope ease of use accessibility user interface joy of use reliability DL Success Model information quality (IQ) performance expectancy (PE) behavioral Intention to (re)use satisfaction system quality (SQ) system quality (SQ) social influence (SI)

41. service accessibility composability reliability reusability ease of use extensibility joy of use efficiency effectiveness reliability screen design navigation Digital Library SQ System Quality (SQ) performance expectancy user interface

42. DL Success Constructs Associated with Seeking and Utilization Phases

44. Outline • Acknowledgements • ETDs and NDLTD • DL curriculum and resource development • Prior work on quality and success models • DL success model • From end user perspective • Summary and Conclusions

45. Summary and Conclusions • ETDs and NDLTD progressing well • DL curriculum and resource development with iterative refinement • Foundation for defining success of DLs from the view of DL end users • Assumes a multi-theoretical perspective • Synthesizes many related research areas in terms of theory and empirical work

46. Selected Links - http://fox.cs.vt.edu • DL curriculum - http://curric.dlib.vt.edu/wiki,http://curric.dlib.vt.edu/DLcurric.html • NDLTD (electronic theses and dissertations worldwide) • www.ndltd.org and etdguide.org • Virginia Tech Digital Library Research Laboratory (DLRL, www.dlib.vt.edu)