1 / 14

Evaluating E-Learning edci.purdue/schaffer/elearningevaluation

Evaluating E-Learning http://www.edci.purdue.edu/schaffer/elearningevaluation.ppt. Introduction to e-Learning Presented by Scott P. Schaffer, Ph.D. Types of E-Learning Decisions. Quality – What does good E-Learning look like? Learning & Transfer – Did it work?

hang
Download Presentation

Evaluating E-Learning edci.purdue/schaffer/elearningevaluation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Evaluating E-Learninghttp://www.edci.purdue.edu/schaffer/elearningevaluation.ppt Introduction to e-Learning Presented by Scott P. Schaffer, Ph.D. Scott Schaffer, Ph.D. 2004

  2. Types of E-Learning Decisions • Quality – What does good E-Learning look like? • Learning & Transfer – Did it work? • Results & ROI– Did it add value? Scott Schaffer, Ph.D. 2004

  3. Good E-Learning…to what end? What is the purpose of the evaluation? • Formative evaluation of newly designed course • Product evaluation of COTS by different vendors • Quality audit of design processes used to develop E-Learning (process vs. product) • Examine specific design effects on learning • Others you can think of …? Scott Schaffer, Ph.D. 2004

  4. E-Learning Quality: System Perspective Feedback-Continuous Improvement Impact on Results? Scott Schaffer, Ph.D. 2004

  5. Key questions to consider before evaluating quality • How aligned are business goals and e-learning program goals or outcomes? • Who are learners? • How motivated are they? • Technology awareness? • Prior knowledge of the subject matter of the course? • Budget? Time frame? • Build or buy? Scott Schaffer, Ph.D. 2004

  6. Why evaluate product quality? • Vendor-created products vary greatly in quality and appropriateness • Determine match of product with specific audience, culture, intended outcome • To validate course content – which is a necessary condition for validation of the effectiveness of a course or program (concurrent validity) Scott Schaffer, Ph.D. 2004

  7. What E-Learning qualities should be evaluated? • Usability • Navigation and control • Technical issues • Content • Instructional design Scott Schaffer, Ph.D. 2004

  8. Sample Tools: Quality Evaluation • Usability • Nielsen's Heuristics • IBM Ease of Use • Instructional Design/Learning Theory • 5 Star Rating – Merrill • CBE - Reeves • Multimedia Design/Cognitive Load • Clark and Mayer: Evaluation Guide (pdf) • Comprehensive • ADL Co-lab • Horton - Checklist Scott Schaffer, Ph.D. 2004

  9. Learning & Transfer Evaluation • Reaction • Skills/Attitude • Application OTJ Scott Schaffer, Ph.D. 2004

  10. E-Learning Reaction Evaluation • Pages accessed • Assignments submitted • Online feedback (handouts 17,19) • Chat and Discussion forum participation Scott Schaffer, Ph.D. 2004

  11. Tools: Learning & Transfer • Peer review and question posts in discussion forum • Quizmaster - Sample quizzes and games for your instructional site • NetG example • Web-based forms (also handouts 38, 41) Scott Schaffer, Ph.D. 2004

  12. Results (Benefits) • Monetary results (profits, revenue, margin, stock price, market share, inventory, customers/accounts) • Intangible results (customer satisfaction, turnover, staff experience/education, reputation) • Confidence estimates (handouts 47,49) Scott Schaffer, Ph.D. 2004

  13. Benefits – Costs / Costs x 100 • Costs of E-Learning vs. Classroom Training • Per course: dvmt. time x cost rate • Per class: instructor travel + facilities x # learners / class size…then per class cost x # of classes • Per learner: time, travel, instructor salary x # learners • ROI Worksheet – see handout Scott Schaffer, Ph.D. 2004

  14. Putting it Together • Evaluation Planning • Tie plan to Kirkpatrick levels • Document business results • Decide why your are evaluating • Collect data from reliable sources • Evaluate at the highest level possible • Sample plan Scott Schaffer, Ph.D. 2004

More Related