1 / 23

Measuring (and Driving) the Value of Training

Measuring (and Driving) the Value of Training. Bruce Winner, Los Rios CCD – Government Training Academy Bruce blogs to the training community at - www.GetResultsFromTraining.com. Objectives.

gmcmullen
Download Presentation

Measuring (and Driving) the Value of Training

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Measuring (and Driving) the Value of Training Bruce Winner, Los Rios CCD – Government Training Academy Bruce blogs to the training community at - www.GetResultsFromTraining.com

  2. Objectives • Find out the difference between a simple evaluation and truly measuring the value of training at the five generally accepted levels. • Discover what measures are most important to management, and how to capture that information. • Stop guessing about the appropriate level of measurement and see what the experts and empirical evidence reveals is optimal. • Explore with your colleagues how to create the systems and practices necessary (before, during, and after training), to ensure that your hard efforts result in real value, measured at an appropriate level.

  3. Is it Worth the Effort? What would being able to measure and prove the value of training --- do for YOU?

  4. ROI Methodology vs Kirkpatrick Four Levels Not mutually exclusive Lots of overlap - ROI methodology built on the Kirkpatrick Model ROI methodology vs ROI (the ratio) I will use BOTH going forward, but…

  5. Over 50 ROI Methodology books and case studies in print

  6. ROI or Kirkpatrick Levels of Measurement Level Measurement Focus 0. Input Measures input such $ spent, people trained, $ per trainee 1. Reaction and Relevance Measures participant reaction to the program, did they find it relevant, and could capture planned action(s) 2. Learning Measures changes in knowledge, skills, and attitudes 3. Application & Implementation Measures what is applied on the job, changes in job behaviors (more of x, less of y) 4. Business Impact (Results) Captures changes in business impact measures (Q.C.O.T) 5. ROI Compares program benefits to program costs (simple ration or benefits minus cost / cost)

  7. Intangible Benefits Adaptability Brand awareness Career minded Caring Collaboration Communication Conflicts Cooperation Corporate social responsibility Creativity Confidence (story) Culture Decisiveness Employee complaints Engagement Execution Image Innovation Job Satisfaction Leadership Networking Organizational climate Organizational commitment Partnering Reputation Resilience Stress Talent Teamwork

  8. Level 5: 5-10% Level 4: 10-20% Level 3: 30% Level 2: 40-60% Level 1: 90-100% Evaluation Targets

  9. The Executive View of Metrics / RESULTS

  10. The Executive View of Metrics / RESULTS

  11. Improving Level 1s Level 1-2 2 - 2.5 2 - 3 3 - 4 Moving up the ladder

  12. The Alignment Process Start Here End Here ROI 5 ROI Objectives 5 Payoff Needs 4 Impact Objectives 4 Impact Business Needs Application 3 Application Objectives 3 Job Performance Needs Measurement and Evaluation Initial Analysis 2 Learning Objectives 2 Learning Learning Needs 1 Reaction Objectives 1 Reaction Preference Needs Project Business Alignment and Forecasting The ROI Process Model

  13. Exercise Matching Evaluation Levels To Objectives Table exercise – Short exercise to reinforce differences in LEVELS of Objectives

  14. Let’s look at five training objectives (below) and see if we can determine their “level” (level 1-5) Perceive the new work schedule system introduced during training as important to agency success. Level ____ Achieve a post-test score increase of 30% over pre-test. Level ____ Use acceptable coaching skills in 90% of situations where work habits are unacceptable. Level ____ Decrease the time from testing to hiring of new analysts from 40 days to 15 days. Level ____ Achieve a 50% return on investment with the new contact center training program for customer service representatives. Level ____

  15. Now it’s your turn!Go to page 6 of your handout.Instructions: For each objective listed below, indicate the level of evaluation at which the objective is aimed. This is more fun as a table-top exercise. Work as a group and try to match an evaluation level to EACH objective in as short a time as possible…

  16. DANGERDANGERDANGER

  17. --- Transfer of Training --- “ Making the Training Stick”

  18. Some Transfer of Training Examples for an Upcoming Exercise The Transfer of Training MATRIX

  19. Transfer of Training - Exercise Directions1) Do the exercise as a table group 2) Each Table has a number (1-9) that corresponds to one of nine squares on the T of T Matrix (see below)THEN – Use the oversized Post-IT Notes to: 3) Each table creates at least one “intervention” or “means to increase transfer of training” at a specific point in time (before, during, or after) with one specific group (participants, trainers, or supervisors) - Your number 1-9 is “your box”4) Then produce 1 or 2 additional interventions for ANY BOX in the matrix5) Post ONLY two to the wall chart (one required and one extra)

  20. Thank you! Please call me if you have any questions or want to talk about “Measuring (or Driving) the Value of Training”. Bruce Winner 916.563.3232 winnerb@losrios.edu And please check out my blog… www.GetResultsFromTraining.com (An unread blog is a terrible thing!)

More Related