Increasing Impact - PowerPoint PPT Presentation

calla
increasing impact n.
Skip this Video
Loading SlideShow in 5 Seconds..
Increasing Impact PowerPoint Presentation
Download Presentation
Increasing Impact

play fullscreen
1 / 14
Download Presentation
172 Views
Download Presentation

Increasing Impact

- - - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

  1. Increasing Impact Understanding Measurements of Impact in Evaluation June 2013 Jennifer Farley

  2. Overview • Why evaluate? • Evaluation: • Types, Continuous Improvement and Neglect • Outputs vs. Impact • Measures of Impact • Is impact good enough? • When it’s not good enough • Maximizing Evaluation • Questions

  3. Why Evaluate? • Ensures Quality • Increases Knowledge • Prioritize Resources • Accountability • Demonstrate need and effectiveness • Marketable (Russ-Eft & Preskill)

  4. Types of Evaluation • Developmental • Formative • Summative • Monitoring and Auditing • Outcome Evaluation • Impact Evaluation • Performance Measurement (Russ-Eft & Preskill)

  5. Continuous Improvement Evaluation

  6. Top 10 Reasons Evaluation is Neglected • Misunderstanding the purpose and role of evaluation • Fear • Lack of Skills (Real or Perceived) • No one has asked for it • It is not used • Time-consuming • Perceived costs vs. Perceived benefit • Leaders already know what works • Prior experience • Lack of Value (Russ-Eft & Preskill)

  7. Outputs and Impact

  8. Measures of Impact • Measures of Change • Attitude, Knowledge and Behavior • Comparison • Pre- and Post-program • Calibration • Is the primary impact what is measured? • Is the program driving the measure, or is the measure driving the program?

  9. Is the Impact Good Enough? • Goals • Program established goals • Funder established goals • Comparison • Population level data • Are the target and general population the same? • The continuum of evaluation and research

  10. When Impact isn’t “Good Enough” • Re-calibrate Measures • What is impact? • Participant focus groups • What best measures impact? • Refine measurement tools • Staff Training • Re-Pilot surveys • Incorporate Measures of Program Quality • Look at HOW programs and services are offered • Explore field-specific measures of quality • Youth Program Quality Assessment • Quality Rating System

  11. Results: Maximizing Evaluation • What is the purpose of the evaluation? • Funder Required? • Is there a requirement to “Act” on the results? • How are the results communicated to all stakeholders? • How are results used in planning?

  12. Questions?

  13. Contact Information Jennifer Farley Censeo Solutions jennifer@censeosolutions.com 515.371.1754 www.censeosolutions.com

  14. Works Cited Russ-Eft, D., & Preskill, H. (2009). Evaluation In Organizations: A systematic approach to enhancing learning, performance, and change.New York: Basic Books.