RBA Results-Based Accountability

1. RBA Results-Based Accountability The Fiscal Policy Studies Instituteraguide.org & resultsaccountability.com Book &DVD Ordersamazon.comclearimpact.com SCORECARD

2. SIMPLE COMMON SENSE PLAIN LANGUAGE MINIMUM PAPER USEFUL

3. RBA in a Nutshell2 – 3 - 7 plus language discipline Results & Indicators      Performance measures 2 - kinds of accountability Population accountability      Performance accountability 3 - kinds of performance measures. How much did we do?      How well did we do it?      Is anyone better off? 7 - questions from ends to means in less than an hour. Baselines & Turning the Curve

4. Population Accountabilityis about the well-being ofWHOLE POPULATIONS for Communities – Cities – Counties – States - Nations Performance Accountabilityis about the well-being ofCUSTOMER POPULATIONS for Programs – Agencies – Service Systems Results-Based Accountabilityis made up of two parts: Population Accountability Performance Accountability

5. THE LANGUAGE TRAPToo many terms. Too few definitions. Too little discipline Benchmark Outcome Result Modifiers Measurable Core Urgent Qualitative Priority Programmatic Targeted Performance Incremental Strategic Systemic Indicator Goal Measure Objective Target Core qualitative strategic objectives Make up your own jargon. Measurable urgent systemic indicators Lewis Carroll Center for Language Disorders

6. RESULT or OUTCOME A condition of well-being for children, adults, families or communities. Population Population INDICATOR or BENCHMARK A measure which helps quantify the achievement of a result. PERFORMANCE MEASURE A measure of how well a program, agency or service system is working.Three types: Performance Performance DEFINITIONS RESULT 1. Children born healthy, Children ready for school, Safe communities, Clean Environment, Prosperous Economy Children born healthy Children ready for school Clean Environment Safe communities Prosperous Economy INDICATOR 2. Rate of low-birthweight babies Rate of low-birthweight babies, Percent ready at K entry, crime rate, air quality index, unemployment rate Percent ready at K entry crime rate air quality index unemployment rate PERFORMANCE MEASURE 3. 1. How much did we do? 2. How well did we do it? 3. Is anyone better off? = Customer Results

7. IS IT A RESULT, INDICATOR OR PERFORMANCE MEASURE? 1.Safe Community 2.Crime Rate 3.Average Police Dept response time 4.Healthy People 5.Rate of obesity 6.People have living wage jobs and income 7.% of people with living wage jobs and income 8.% of participants in job training who get living wage jobs RESULT INDICATOR PERF. MEASURE RESULT INDICATOR RESULT INDICATOR PERF. MEASURE

8. Population Accountability

9. Community Outcomesfor Christchurch, NZ Example ofresults forall residents ● A Safe City ● A City of Inclusive and Diverse Communities ● A City of People who Value and Protect the Natural Environment ● A Well-Governed City ● A Prosperous City ● A Healthy City ● A City for Recreation, Fun and Creativity ● A City of Lifelong Learning ● An Attractive and Well-Designed City

10. CARDIFF, WALESCommunity Outcomes 1. People in Cardiff are healthy 2. Cardiff has a clean attractive and sustainable environment 3. People in Cardiff are safe and feel safe 4. Cardiff has a thriving and prosperous economy 5. People in Cardiff achieve their full potential. 6. Cardiff is a great place to live, work and play. 7. Cardiff has a fair, just and inclusive society.

12. Getting from Talk to Action

13. Leaking Roof(Results thinking in everyday life) ? Fixed Experience Inches of WaterBASELINE Not OK Measure Turning the Curve Story behind the baseline (causes) Partners What Works Action Plan # 2 Action Plan

14. Results / Outcomes Indicators Baseline & Story

15. 75 people per day 45 people per day MADD 28 people per day 2010

17. Rebound

18. Hull, UK"Woundings"

19. Performance Accountability

20. % Common measures e.g. client staff ratio, workload ratio, staffturnover rate, staff morale, % staff fully trained, % clients seen in their own language,worker safety, unit cost % Activity-specific measures e.g. % timely, % clients completing activity, % correct and complete, % meeting standard % Skills / Knowledge (e.g. parenting skills) # % Attitude / Opinion (e.g. toward drugs) # Point in Timevs.2 Point Comparison % Behavior (e.g.school attendance) # % Circumstance (e.g. working, in stable housing) # Performance AccountabilityTypes of Measures found in each Quadrant How well did we do it? How much did we do? # Clients/customers served # Activities (by type of activity) Is anyone better off?

21. Education Quality Quantity How well did we do it? How much did we do? Student-teacherratio Number ofstudents Effect Effort Is anyone better off? Number ofhigh schoolgraduates(completionor certificate rate) Percent ofhigh schoolgraduates(completionor certificate rate)

22. Pediatric Practice Quality Quantity How well did we do it? How much did we do? Percent ofpatients waitingless than30 minutes in thewaiting room Number ofpatientstreated Effect Effort Is anyone better off? #childrenfullyimmunized(in the practice) %childrenfullyimmunized(in the practice)

23. Drug/Alcohol Treatment Program Quality Quantity How well did we do it? How much did we do? Percent ofstaff withtraining/certification Number ofpersonstreated Effect Effort Is anyone better off? Number of clientsoff of alcohol & drugs- at exit - 12 months after exit Percent of clientsoff of alcohol & drugs- at exit - 12 months after exit

24. Fire Department Quality Quantity How well did we do it? How much did we do? ResponseTime Number ofresponses Effect Effort Is anyone better off? # of fireskept toroom of origin % of fireskept toroom of origin

25. Service: __________________________________ Hospital Job Training School Fire Department How well did we do it? How much did we do? Primary customers Unit cost persons trained patients students # Workload ratio Primary activity % of ___x___ that happen on time job courses alarms responded to diagnostic tests hours of instruction # Is anyone better off? If your service works really well,how are your customer's better off? # students who graduate persons who get jobs patients who fully recover fires kept to room of origin %

26. LR UR Baseline & Story Primary v. Secondary Direct v. Indirect Internal v. External

29. PuttingPopulation Performance Accountability TOGETHER and

30. THE LINKAGE Between POPULATION and PERFORMANCE POPULATION ACCOUNTABILITY Healthy Births Rate of low birth-weight babiesChildren Ready for SchoolPercent fully ready per K-entry assessmentSelf-sufficient FamiliesPercent of parents earning a living wage PERFORMANCE ACCOUNTABILITY POPULATIONRESULTS Contributionrelationship Alignmentof measures Job Training Program Unit costper persontrained # personsreceivingtraining Appropriateresponsibility % who getliving wage jobs # who getliving wage jobs CUSTOMERRESULTS

31. Population Accountability Result: to which you contribute to most directly. Indicators: Story: Every timeyou presentyour program, Use atwo-partapproach. Partners: What would it take?: Your Role: as part of a larger strategy. Your Role Performance Accountability Program: Performance measures: Story: Partners: Action plan to get better:

32. Population Turn the CurveEXERCISE

33. 65% Now Creating a Working Baselinefrom Group Knowledge Indicator or Performance Measure Not OK? Forecasting Backcasting

34. Turn the Curve Exercise: Population Well-being 5 min: Starting Points - timekeeper and reporter - geographic area - two hats (yours plus partner’s) 10 min: Baseline - pick a result and a curve to turn - forecast (to 2022) – OK or not OK? 15 min: Story behind the baseline- causes/forces at work - information & research agenda part 1 - causes Two pointers to action 15 min: What works? (What would it take?)- what could work to do better? - each partners contribution - no-cost / low-cost ideas - information & research agenda part 2 – what works 10 min: Reportconvert notes to one page

35. 4. --------- Off the Wall ONE PAGE Turn the Curve Report: Population Result: _______________ Indicator(Lay Definition) IndicatorBaseline Story behind the baseline --------------------------- --------------------------- (List as many as needed) Partners --------------------------- --------------------------- (List as many as needed) Three Best Ideas – What Works1. --------------------------- 2. --------------------------- 3. ---------No-cost / low-cost SharpEdges 4. --------- Off the Wall

36. Performance Turn the Curve EXERCISE

37. Turn the Curve Exercise: Program Performance 5 min: Starting Points- timekeeper and reporter - identify a program to work on - two hats (yours plus partner’s) 10 min: Performance measure baseline- choose 1 measure to work on – from the lower right quadrant - forecast (to 2020) – OK or not OK? 15 min: Story behind the baseline- causes/forces at work - information & research agenda part 1 - causes Two pointers to action 15 min: What works? (What would it take?)- what could work to do better? - each partners contribution - no-cost / low-cost ideas - information & research agenda part 2 – what works 10 min: Reportconvert notes to one page

38. 4. --------- Off the Wall ONE PAGE Turn the Curve Report: Performance Program: _______________ Performance Measure (Lay definition) PerformanceMeasureBaseline Story behind the baseline --------------------------- --------------------------- (List as many as needed) Partners --------------------------- --------------------------- (List as many as needed) Three Best Ideas – What Works1. --------------------------- 2. --------------------------- 3. ---------No-cost / low-cost SharpEdges 4. --------- Off the Wall

39. Turn the Curve Exercise – LessonsTalk to Action in an hour 1. How was this different from other processes? What worked and what didn’t work? 2. Why did we ask for: a. Results before indicators? b. Forecast? c. Story? d. No cost / low cost? e. Two hats? f. Crazy idea? g. Only 3 best ideas? 3. Do you think a lay audience could understand the reports? 4. How many think you could lead this exercise with a small group? (2+ curves at the same time)

40. Next Steps What’s one thing I can personally do with what I learned today?

41. Resources raguide.org resultsaccountability.com clearimpact.com RBA Facebook Group Book &DVD Ordersamazon.comclearimpact.com SCORECARD

42. THANK YOU ! Book - DVD Ordersamazon.comresultsleadership.org