District and School Performance Frameworks 101

1. District and School Performance Frameworks 101 Colorado Department of Education Webinar September 2011 http://www.cde.state.co.us/Accountability/Downloads/SPF-WebinarSept2011.pptx

2. Agenda • The Big Picture • Background on the DPF/SPF • Measures and metrics on the SPF • Walkthrough of the SPF • Uses of the DPF/SPF • Additional Tools & Support from the State

3. Where do the DPF/SPF fit into CDE’s strategic priorities? DRAFT Setting high standards for what all students should know and be able to do Assessing and supporting students in mastering the standards Ensuring effective educators for every student and effective leaders for every school CDE’s Strategic Priorities High Expectations Effective Educators Every Student Career & College Ready Every Student Career & College Ready Innovation & Choice Accountability & Improvement OrganizationalExcellence Measuring how well schools and districts are meeting the needs of students Using data to continuously improve district, school, and student performance Fostering and enabling innovative approaches to teaching and learning Ensuring students and their families can choose the schools that best meet their needs

4. Aligning Accountability and Support All students will exit Colorado’s K-12 education system ready for postsecondary education and workforce success. - Colorado's Achievement Plan for Kids (CAP4K) SB08-212 • Federal Accountability • NCLB • Special Education • State Accountability • Accreditation • PPR Competitive Grants and Strategic Partnerships

5. Aligning Accountability and Planning All students will exit Colorado’s K-12 education system ready for postsecondary education and workforce success. - Colorado's Achievement Plan for Kids (CAP4K) SB08-212 UIP UIP UIP UIP UIP UIP SPF/DPF Grad. AYP HQ AMAO Program Performance • Federal • NCLB • Special Education • State • Accreditation • PPR Competitive Grants and Strategic Partnerships

6. Agenda • The Big Picture • Background on the DPF/SPF • Measures and metrics on the SPF • Walkthrough of the SPF • Uses of the DPF/SPF • Additional Tools & Support from the State

7. DPF and SPF Background • Required by the Education Accountability Act of 2009 (SB-163) • All districts receive a District Performance Framework (DPF). This determines their accreditation rating. • All schools receive a School Performance Framework (SPF). This determines their school plan types. • All districts and all schools submit an improvement plan using the Unified Improvement Plan template. Components: • Trends, Root Causes, Targets, Strategies, Resources, Interim Measures & Implementation Benchmarks

8. DPF and SPF Purposes • Focus attention on what matters most. • Provide a body of evidence related to state-identified performance indicators to support school and district performance management. • Support school and district efforts to evaluate their performance. • Establish a common framework for the state to use to hold schools accountable for performance. • Identify schools that need additional support (Priority Improvement and Turnaround).

9. Accreditation & Plan Types • Accreditation designations: • Accredited with Distinction (10%) • Accredited (50%) • Accredited with Improvement Plan (25%) • Accredited with Priority Improvement Plan (10%) • Accredited with Turnaround Plan (5%) • School plan types: • Performance Plan (60%) • Improvement Plan (25%) • Priority Improvement Plan (10%) • Turnaround Plan (5%) • Implications

10. Distribution of Preliminary School Performance Framework Plan Assignments, 2010

11. Timeline for District Accreditation & Plan Submission

12. Timeline for School Plan Type Assignment & Plan Submission

13. Agenda • The Big Picture • Background on the DPF/SPF • Measures and metrics on the SPF • Walkthrough of the SPF • Uses of the DPF/SPF • Additional Tools & Support from the State

14. Performance Indicators & Data

15. How does the framework focus on these indicators? • Assigns a rating to each of the performance indicators: • Exceeds, Meets, Approaching, Does not meet • The ratings roll up to an overall evaluation of the school/district’s performance, which determines the school’s plan type assignment: • Performance, Improvement, Priority Improvement, Turnaround

16. 1 year vs. 3 year data • CDE provides two different versions of the School Performance Framework Reports: • The most recent year of data (1-year SPF, 2011) • The most recent three years of data (3-year SPF, 2011) • Only one report counts for official accountability purposes: • The one under which the school has ratings on a higher number of the performance indicators, or • If the school has ratings under an equal number of indicators, the one under which it received a higher total number of points.

17. Agenda • The Big Picture • Background on the DPF/SPF • Measures and metrics on the SPF • Walkthrough of the SPF • Uses of the DPF/SPF • Additional Tools & Support from the State

18. School Performance Framework Overview • Page 1: Summary of school performance, including plan type assignment and ratings for each performance indicator • Page 2: Details of school performance by indicator and sub-indicator • Page 3: Scoring guides including cut scores • Page 4: Comparison data

19. DPF/SPF Expectations

20. DPF/SPF Expectations

21. Academic Achievement (status) • Performance Data: the percent of students in the school scoring at the proficient or advanced achievement level • Comparison: Compared to the distribution of percent proficient and advanced scoring students in all other schools* in the state. • Scoring Guide: sets the percentile cut-points for each rating. • Approaching = 15th percentile • Meets = 50th percentile • Exceeds = 90th percentile * Does not included schools with N of less than 16 or Alternative Education Campuses

22. Academic Growth • Performance data: Median Growth Percentile and Median Adequate Growth • Comparison: • What was my school’s median growth percentile? • Was my school’s median growth percentile adequate? (yes or no) • How did my school’s median growth percentile compare to state expectations for growth? • Scoring guide:sets the cut-points for median growth percentile using two tables that depend on whether or not the school met adequate growth

23. Scoring Guide/Decision Tree for Academic Growth

24. Adequate Growth • What is adequate growth? • Based on catch-up and keep-up growth.

25. Calculating Adequate Growth for Students Scoring Below Proficient: Catching Up 6th grade 7th grade 8th grade 9th grade 10th grade Proficient 76 is the minimum-this student’s adequate growth percentile 80 85 95 76 80 76 85 Not Proficient 80 76 76

26. Calculating Adequate Growth for Students Scoring Below Proficient: Catching Up 6th grade 7th grade 8th grade 9th grade 10th grade 55th percentile growth will not be enough for this student to catch up – his current growth is not adequate. Proficient 76 76 76 76 Not Proficient 55 55 55 55

27. Calculating Adequate Growth for Students Scoring Above Proficient: Keeping Up 6th grade 7th grade 8th grade 9th grade 10th grade Proficient 79 50 50 is the maximum -this student’s adequate growth percentile 38 25 50 38 50 25 38 50 12 Not Proficient

28. Calculating Adequate Growth for Students Scoring Above Proficient: Keeping Up 6th grade 7th grade 8th grade 9th grade 10th grade 79 79 Proficient 79 79 50 50 50 79th percentile growth will be enough for this student to keep up – his current growth is adequate. 50 Not Proficient

29. Median Adequate Growth AGP Sorted AGPs Median AGP 45 78 99 32 11 91 55 67 43 10 77 Median Adequate Growth for this school is 55 Adequate growth percentiles for all catch-up and keep-up students Search for the middle value…

30. Adequate Growth • What was my school’s median growth percentile? • Was my school’s median growth percentile adequate? • If MGP > AGP = yes • If MGP < AGP = no • How did my school’s median growth percentile compare to the state’s expectations for growth? • Plug into Growth Scoring Guide/decision tree

31. Scoring Guide/Decision Tree for Academic Growth

32. Growth Gaps • Performance data: Median Growth Percentile and Median Adequate Growth for disaggregated student groups • Comparison: • What was the disaggregated group’s median growth percentile? • Was the group’s median growth percentile adequate? (yes or no) • How did the group’s median growth percentile compare to state expectations for growth? • Scoring guide:sets the cut-points for median growth percentile using two tables that depend on whether or not the school met adequate growth

33. Postsecondary and Workforce Readiness • See the back page of the performance framework report for: • The state average dropout rate. • The state average ACT Composite Score. • Note: State averages are different for 1-year vs. 3-year metrics.

34. On-Time and Adjusted YearGraduation Rates

35. IndicatorPoints • Points earned on a scale of 0-4 • Sum the sub-indicator points for the total indicator points. • Convert to % (points earned/points eligible for the indicator).

36. Indicator Ratings • Based on the % of points earned of the points eligible for the indicator. • Cut-points on page 3 of SPF

37. Framework (Weighted) Points • Each indicator is weighted differently in the overall plan type assignment (page 1 SPF). • Multiply the percent of points earned by the weight for each indicator (Eligible points). • These are your framework points for each indicator.

38. Arriving at a Plan Type Assignment • Sum framework points for each indicator. • Convert this sum to a percentage (of 100). • Use % of framework points to determine the plan type assignment. • See “Cut-points for plan type assignment” on page 3 to determine plan type assignment.

39. Agenda • The Big Picture • Background on the DPF/SPF • Measures and metrics on the SPF • Walkthrough of the SPF • Uses of the DPF/SPF • Additional Tools & Support from the State

40. Uses of the DPF/SPF • Select a report www.schoolview.org/performance.asp • What does the report tell you? • Where is the school doing well? • Where is it struggling? • What doesn’t the report tell you ? • What additional information do you need to understand its performance? • How can you use your SPF/DPF in your UIP?

41. District Performance Framework • Mirrors the School Performance Framework • Distribution of district accreditation categories similar to school plan type distribution • 10% Accredited with Distinction • 50% Accredited • 25% Accredited with Improvement Plan • 10% Accredited with Priority Improvement Plan • 5% Accredited with Turnaround Plan • Safety and Finance assurances • Districts not meeting either their Safety or Finance assurances will default to Accredited with Priority Improvement (or stay in Priority Improvement or Turnaround if they are already there) until they meet requirements.

43. Agenda • The Big Picture • Background on the DPF/SPF • Measures and metrics on the SPF • Walkthrough of the SPF • Uses of the DPF/SPF • Additional Tools & Support from the State

44. Additional Resources • CDE Accountability Website: http://www.cde.state.co.us/Accountability/index.asp • SPF Tutorial: http://www.cde.state.co.us/media/training/SPF_Online_Tutorial/player.html • UIP Website: http://www.cde.state.co.us/Accountability/UnifiedImprovementPlanning.asp • SchoolView: http://www.schoolview.org/ • Colorado Growth Model • SchoolView Data Center • SchoolView Data Lab

45. Additional Resources • CDE Staff • Bill Bonk, Longitudinal Growth Consultant, bonk_w@cde.state.co.us • Marie Huchton, Senior Statistical Consultant, huchton_m@cde.state.co.us • Somoh Supharukchinda, State Accountability, supharukchinda_s@cde.state.co.us • Federal Programs Staff • http://www.cde.state.co.us/FedPrograms/ov/contacts.asp - Alyssa Pearson & Donna Morganstern