1 / 39

Why Data Matters! Building and Sustaining a Business Case

Why Data Matters! Building and Sustaining a Business Case. Kansas City NEUAC June 18, 2014. Presentation Outline. Performance Metrics Example Findings from Evaluation Targets for Performance Measurement Follow-Up Assessment through Evaluation Using Evaluation to Quantify Benefits

rafael-day
Download Presentation

Why Data Matters! Building and Sustaining a Business Case

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Why Data Matters!Building and Sustaining a Business Case Kansas City NEUAC June 18, 2014

  2. Presentation Outline • Performance Metrics Example • Findings from Evaluation • Targets for Performance Measurement • Follow-Up Assessment through Evaluation • Using Evaluation to Quantify Benefits • Elderly Health Benefits from Air Conditioning • Client Affordability Benefits from WX • Societal Environmental Benefits from WX • Using Evaluation to Dispel Myths • Speak with Confidence about “Take-Back” 2

  3. Performance Metrics Example 3

  4. Performance Measurement is Cool (60s), Radical (80s), Awesome (90s), Sick! (current) …and a lot of different types of people/organizations are doing it 4

  5. NBA EXAMPLERose is the type of player who is defined by more than his statistics. His impact on the offense goes beyond what he contributes to box scores. Before his injury issues started escalating in 2012, the Bulls were the third most efficient offense in the NBA, per NBA.com/STATS.Modern analytics have helped to shape what offenses do. By tracking shot locations, it’s become apparent that some areas of the court are more critical than others…. By Kelly Scaletta, Featured Columnist Aug 15, 2013 http://bleacherreport.com/articles/1739774-what-is-the-derrick-rose-effect 5

  6. Why would an NBA Player hire a personal Data Analyst?To get better!To sit beside him/her during contract negotiations! 6

  7. Why would the LIHEAP Program or the Weatherization Program get involved with Performance Measurement?To get better!To use during contract negotiations …. budget discussions! 7

  8. Performance Metrics FrameworkProgram Evaluation vs. Performance Measurement 8

  9. Comparison 9

  10. Weatherization Evaluation 10

  11. Explanatory Factors 11

  12. Field Inspections • High Priority Measures: Were all wall insulation and attic insulation opportunities addressed? What are the opportunities and barriers? • Furnace Replacements: What share of furnace replacements were required for health and safety? • Measure Prioritization: How were measures prioritized for each home? • Cost per Home: What are the cost implications for changing measure priorities? 12

  13. Performance Goals • Wall Insulation – From 10% to 20% • Attic Insulation – From 60% to 70% • Furnace Replacement – From 39% to 30% • Maintain ALL Health and Safety Replacements • Spending – Limit annual increase to 3% 13

  14. Follow-Up • Staff Reports – Successes in and/or barriers to installing attic and/or wall insulation. • Quarterly Report – Installation rates vs. installation targets, including required H&S measures. • Annual Report – Summary statistics AND outcomes of field inspections. • Follow-Up Evaluation – Do changes in performance lead to improvements in savings? 14

  15. Documenting Program Benefits 15

  16. Colorado EvaporativeCooler Program • Program Target – Elderly and disabled clients in hot areas. • Intervention – Install modern evaporative coolers that use no more energy than fans. • Question – How does this impact clients who receive the intervention? • Method – Baseline interview in Summer 2008 / Follow-up interview Summer 2009 (Interviews matched for time and temperature) 16

  17. Elderly/Disabled Client Health Outcomes 17

  18. Conclusions • Having air conditioning and using it, reduces the incidence of heat related illness symptoms. • Having air conditioning and using it increases the independence of elderly and disabled individuals. 18

  19. Weatherization ProgramAffordability Impacts • Program Target – Low-Income Households. • Intervention – Comprehensive Weatherization Services / WAP and LIHEAP. • Question – How does weatherization affect energy bill affordability for clients? • Method – Client Survey PreWX compared to Client Survey Post-WX. 19

  20. Low-Income HouseholdAffordability Outcomes 20

  21. Conclusions • Getting comprehensive weatherization helps clients to pay their utility bills. • Getting comprehensive weatherization helps clients to avoid short-term high interest loans that lead to more trouble in the long run. 21

  22. Weatherization Program Emissions Impacts for a Representative State 22

  23. Weatherization “Take Back” 23

  24. “Take Back” Issue “Weatherizing the homes of low-income households doesn’t save energy. After weatherization clients just turn up the thermostat and don’t have any reduction in energy use” 24

  25. Client Comfort 25

  26. Client Comfort 26

  27. Determinants of Comfort 27

  28. Client Comfort 28

  29. WAP Occupant SurveyShows… • Client perceptions of cold vs. comfortable mainly related to draftiness, not to thermostat settings. • PostWX comfort levels high without higher thermostat settings. • But … these are just survey data …. 29

  30. WAP Field StudyShows… • Temperatures go up in some homes. • Temperatures go down in other homes. • Measured indoor temperatures preWX vs. PostWX do not change. 31

  31. Case 1: -28% savings

  32. 2348-0038 (ID) 442

  33. Ceiling insulation • Floor insulation • Air leakage reduction from 2,000 to 1,500 CFM50 • Heating system replacement 7012--0118 (MO) 636

  34. Ceiling insulation (4 bags) • Floor insulation (2 bags) • Air leakage reduction from 2,000 to 1,500 CFM50(measured 2,100 at time of visit) • Heating system replacement (gas heater broke year before Wx) • …and client reported keeping thermostat set higher afterWx (for health reasons)

  35. Conclusions • Some clients “take back”. Once their home is weatherized they can heat their homes to a safe and comfortable level. • Some clients “give back.” Once their homes is weatherized they can lower the thermostat setting and still be comfortable. 36

  36. Summary 37

  37. Data is used for… • Benchmarks… • Understanding who clients are, what issues they faced, and what benefits they received. • Evaluation and Measurement… • Evaluation to identify high impact services/strategies AND on-going measurement to track progress toward goals. • Partnership • Field staff report on client needs and services, management tracks progress against goals, policymakers pay attention and furnish more $$$, AND available $$$ can go farther and have more impact!! 38

  38. Contact David Carroll, 609-252-8010 david-carroll@appriseinc.org APPRISE 32 Nassau Street, Suite 200 Princeton, NJ 08540 39

More Related