1 / 18

e-MapScholar: User Needs Analysis and Evaluation

e-MapScholar: User Needs Analysis and Evaluation. Project Aim and Duration. e-MapScholar aimed to produce a range of materials that encourage and support the use of spatial data, including the digital map data available from EDINA Digimap, in learning and teaching

kalyca
Download Presentation

e-MapScholar: User Needs Analysis and Evaluation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. e-MapScholar: User Needs Analysis and Evaluation

  2. Project Aim and Duration • e-MapScholar aimed to produce a range of materials that encourage and support the use of spatial data, including the digital map data available from EDINA Digimap, in learning and teaching • Duration of e-MapScholar: January 2001 to April 2003 • Project website: http://edina.ac.uk/projects/mapscholar/index.html

  3. Parties involved • Funded by JISC under 5/99 Programme • Led by EDINA/Data Library, University of Edinburgh • Associate Partners: School of Geosciences, University of Edinburgh; School of Civil Engineering and Geosciences, University of Newcastle; Institute of Educational Technology, Open University • Advisors and Associates: LTU, University of Aberdeen; LTSN Subject Centres GEES and Built Environment; Dept of Information Science at City University; Netskills at University of Newcastle; and Ordnance Survey • Teaching colleagues from around the UK have authored case studies and online materials

  4. 3 Activity Areas • Teaching Case Studies • Online learning materials • Learning Resource Centre • Content Management System • Virtual Placement

  5. IET at OU Prof Eileen Scanlon Dr Canan Blake Dr Erica Morris Dr Clare Davies, Psychologist Also Project Advisors L&T input from Subject Centres and LTU Evaluation Team

  6. Evaluation Framework: CIAO!

  7. Previous Digimap evaluations (context) Needs Analysis Formative evaluation Beta testing Cognitive Walkthrough Evaluation Activities

  8. Digimap project work in HE and FE Impact assessments Context (1)

  9. Review of web based learning materials Review of geo-spatial web based learning materials Review of pedagogy concerning web based learning Requirements report Context (2)

  10. Survey of teaching concepts 3 mind maps Online teaching needs survey (April/May 2001) 18 respondents Requirements workshop (July 2001) 14 attendees Needs Analysis

  11. First review (November 2001) 2 expert users 1 recent graduate Usability review (July 2002) 5 expert users 4 learners working through learning resources 1 student working through virtual placement Formative Evaluation

  12. With students at Aberdeen and Cardiff (November 2002) Feedback via online questionnaires (13) and open-ended forms (16) Beta testing

  13. Questions in beta testing • Likes/dislikes • Navigation • Usability • Perceived visual quality and impact • Clarity of instructions • Ease of use of tools • Difficulties experienced • Time taken • Other comments

  14. With 3 research staff at OU Representative tasks Researchers reviewed actions needed to complete the task Assessed how users would behave and problems they might experience Provided critiques Cognitive Walkthrough

  15. Other evaluation work • Accessibility • Reviewed by RNIB at ALT-C workshop • Reviewed by GEES in link with TechDis • Workshops • Conferences and other fora • February 2003: University of Aberdeen • March 2003: University of Edinburgh

  16. Issues • Evaluating complex digital resources • Negotiating distance between developers and evaluators • Pedagogical context • Change within first few months of project from proposal • Customisation challenges • What could be evaluated and when • Practical constraints – need for flexibility

  17. Key lessons • Respect for evaluators by developers and vice versa • Strong evaluator needed • Importance of having external evaluators • Bringing in external expertise • Providing comparison with other development project work • The independent view • Usability first – then broader learning and educational considerations (C.Blake)

  18. Contact Moira Massey Moira.Massey@ed.ac.uk 01744 623079

More Related