Evaluation models

1. Evaluation models

2. Evaluation Models • Evaluation of e-learning, learning and training programs has become a widely researched area. • In evaluating learning or instruction the things to be searching are: 1 • Did the trainees like the training? 2 • Was the training relevant? 3 • Was the time spent by the trainee well spent? 4 • Did they experience what was intended or something completely different? 5 • Did they advance, if so at what level? 6 • Was their a change in behavior due to the training and is the trainee aware of the change?

3. Evaluation Models • one could ask questions about the effectiveness and efficiency of a training module or educational course, depending on what you are trying to evaluate. • try to get a basic idea of what evaluation and evaluation models. • To effectively examine an evaluation model first explain what an evaluation program is and find the purpose that it serves. • Are all evaluation models the same? • Are they all evaluating the same things? • Can different models be used in different circumstances or contexts?

4. Evaluation Models • These are the questions ask ourselves when examining the following evaluation models. • The evaluation model is systematic approach that will guide in measuring the efficiency and effectiveness of a training, a course or an educational program. • The three models be reviewing in this particular article are the following: 1 • Kirkpatrick's four levels of training evaluation (A fifth element ROI has since been added) 2 • The Stuffle beam CIPP Evaluation Model (Context, Input, Process and Product Evaluation) 3 • Flashlight Triad Model

5. Kirkpatrick's 4 Levels of Evaluation • Kirkpatrick has defined four levels of evaluation • Kirkpatrick Level 1 – • Reactions/Learner Satisfaction - Ask questions like, “Did they like it?” or • “Was the material relevant to their work?” - This type of evaluation is often called a smile sheet. • Kirkpatrick Level 2 • Learning - Goes beyond satisfaction, attempts to assess the extent that learners have advanced in skills, knowledge and attitude

6. Kirkpatrick's 4 Levels of Evaluation • Kirkpatrick Level 3 • Transfer –trainers attempt to determine the skills, knowledge, or attitude has been effectively transferred into everyday life activities. • measuring is impossible to predict when the behavior change has taken place so the time to evaluate must be carefully calculated and chosen. • Kirkpatrick Level 4 • Results - measures the success of the program in - managers and executives can understand, -increased production, -improved quality, decreased costs, - reduced frequency of accidents, increased sales, and - higher profits or Return On Investment (ROI).

7. Stufflebeam's CIPP Evaluation Model • Context, Input, Process, and Product Evaluation • Daniel Stuffle beam's CIPP Model (2002) is based on the premise that evaluations should assess and report an entity's merit, worth, and significance as well as, the lesson learned. • The CIPP model's main theme is that evaluation's most important purpose is not to prove, but to improve.

8. Stuffle beam's CIPP Evaluation Model

9. Stuffle beam's CIPP Evaluation Modelin brief..

10. Flashlight Triad Model • The Flashlight Triad Model covers 5 distinctive steps • Overview and Confronting the Blob -Brainstorming brings to light all the elements that feed into whatever it is you are evaluating. 2. From Blob to Issue To narrow down the Blob this step focuses on choosing which elements you think are crucial to evaluate 3. From Issue to Triad Take the elements you chose and create Triads which consist of the • type of technology that is employed (T), • the activity the technology enables (A), and • outcomes expected from the activity (O).

11. Flashlight Triad Model 4. From Triad to Data -From the Triads, now questions are created to gather data about the Triads; • These questions usually fall into one of 5 categories: 1 • Technology 2 • Interaction of Technology and Activity 3 • Activity 4 • Interaction of Activity and Outcomes 5 • Outcomes 5. From Data to Next Steps • After analyzing the data collecting and answering the questions created modifications are made.