School and District Report Cards

1. School and District Report Cards September 12, 2013 Jonathan Wiens, PhD Office of Assessment and Information Services Oregon Department of Education

2. Today’s Topics • Timeline • Report Card Ratings Review • Review of the new Report Cards

3. Sept 12 Report Card validation opens (English only) Sept 12-23 Validation for Supplemental Data Collection (Letters and Curriculum) Sept 19 Spanish report card preview opens October 3 Final preview of Report Cards and suppressed Ratings Details October 7 Media receives embargoed files October 10Public release of Report Card and Ratings * - handouts and video for this and other trainings at: https://district.ode.state.or.us/search/page/?id=226 Report Card Timeline

4. Achievement Data Insight Application New validation site – see the July 12th video training at https://district.ode.state.or.us/search/page/?id=226 for more details

5. Achievement Data Insight • This is the new site that hosts Report Card Validations. • Debuted on June 6 • Suggestions for improvement are welcome. • ODE hosted a training on June 6, available at the Video Training site: https://District.ode.state.or.us/search/page/?ID=226 • Contact District Security Administratorhttps://district.ode.state.or.us/apps/login/searchSA.aspx • Permissions are set by validation type

6. Application Landing Page If you do not see the application, contact your district security administrator.

7. Application Landing Page • Validations tiles • Latest validation information • Status/Count down • Open and All tabs • Options Menu

8. Report Card Validation “Details” report provides the data included in the rating. “Summary” is the actual report card. “Language” will include Spanish on September 19th. Suppressed details available on October 3rd.

9. Report Card Rating Details Overview -- See the July 12th video training at https://district.ode.state.or.us/search/page/?id=226 for more details

10. Oregon’s School Rating Model School ratings are rated based on 5 main factors: • Achievement: percent met in reading and math • Growth: individual student growth in reading and math • Subgroup Growth: growth for historically underserved subgroups* • Graduation: cohort graduation rates • Subgroup Graduation: graduation rates for historically underserved subgroups* * - Economically disadvantaged; Limited English Proficient; Students with disabilities; and a combined American Indian/Alaska Native, Black, Hispanic, and Native Hawaiian/Pacific Islander subgroup.

11. Weighting in Overall Rating Categories are weighted according to the table below:

12. Oregon’s School Rating Model • Schools receive a rating of Level 1 (lowest) to Level 5 (highest) and points in each of the categories • The percentage of points earned for each indicator are combined into an overall score and Level for the school. • Missing one or more participation targets lowers the rating by one level. • A “Level 1” in graduation means the school’s rating can be no higher than Level 2.

13. School Ratings Schools are given one of five rating Levels. These levels can be described as follows: • Level 5 The top 10% of all schools in the state (5% of Title I schools) • Level 4 Above average, generally meeting AMOs • Level 3 Below average, but not in the lowest 15% • Level 2 In the lowest 15% of schools • Level 1 In the lowest 5% of schools in the state. Final ratings were posted on August 22nd.

14. 2012-2013 School Ratings • (Almost) All schools receive a rating. • New schools and small schools will not be rated. • No new priority or focus schools. • Schools identified last year remain priority or focus schools for 2013-14 and beyond. • There will be a new list of Model schools. • Title I schools with a Level 5 rating

15. School Report Card Redesign Detailed Review of Data Included

16. Report Card Redesign • As part of the ESEA Waiver Oregon committed to a redesign of the school and district report cards. • A Report Card Steering Committee was appointed, consisting of a diverse group of Oregon Stakeholders. • First meetings were in October 2012 and final recommendations were given to ODE in April 2013. • Details posted at: http://www.ode.state.or.us/search/page/?id=3881 • State Board approved the redesign at its May meeting.

17. Validation Notes This front page will only show during the preview window. It will not be included in the public release. It will contain information pertinent to each preview.

18. Report Card Redesign This is page one of the Elementary school prototype. All prototypes are available at: http://www.ode.state.or.us/search/page/?id=3881

19. Letter from the Principal • Provided to ODE via the Supplemental Data Collection. • English and Spanish translations must be provided. • Header data comes from our Institutions database. • Please check that the website link is correct.

20. School Profile • Data comes from 3rd Period Cumulative ADM. Gives a “May 1” snapshot of the school. • English Learners – “Ever EL,” includes students reported as EL since 2006-07 in Oregon. This definition is used everywhere, except for high school outcomes. • Students attending 90% or more days aligns to the “Not Chronically Absent” measure on the Achievement Compacts.

21. School Rating • The Schools Report Card Rating is shown on the left • Schools are placed in one of three positions within each level based on their “Weighted Percent.” • On the right, schools are identified as being in (approximately) the top, middle or bottom third of comparison schools.

22. Comparison Schools • Comparison schools are based on a combination of: • Percentage of economically disadvantaged students • Percentage of English learners (using ever-EL) • Percentage of underserved races/ethnicities: American Indian/AK Native, Black, Hispanic, and Pacific Islander • Within school year mobility rates • Each school has up to 20 comparison schools that are used for all “Like-School” measures on the report card. • Comparison school ratings indicate whether or not the school’s “Weighed Percent” puts them in the top third, middle third, or bottom third of its comparison schools. • For other measures the students in the comparison schools are pooled and the rate for the pooled group is calculated.

23. Comparison Schools • Rating on the left comes from the ratings detail sheets. • Schools are placed in one of three positions within each level based on their “Weighted Percent.” • Comparison schools are determined using a combination of: • Percent economically disadvantaged • Percent English learners (using ever-EL) • Percent underserved races/ethnicities: American Indian/AK Native, Black, Hispanic, and Pacific Islander • Within school year mobility • Each school has up to 20 comparison schools that are used for all “Like-School” measures on the report card. • Comparison school ratings indicate whether or not the school’s “Weighed Percent” puts them in the top third, middle third, or bottom third of its comparison schools. • For other measures the students in the comparison schools are pooled and the rate for the pooled group is calculated.

24. Report Card Redesign This is page two of the Elementary school prototype. High schools have graduation data here. All prototypes are available at: http://www.ode.state.or.us/search/page/?id=3881

25. Progress • Shows assessment performance for the last four years. • Includes all students enrolled on May 1 that were full academic year. Rules match those on the ratings details. • School results are suppressed if fewer than 6 students, >95% met/exceeded, or <5% met/exceeded. • Participation rate won’t be checked on this first preview.

26. Outcomes (Elem/Middle) • Shows 2012-13 results for student subgroups. • Includes students enrolled on May 1 for a full academic year. • Includes comparison to the state. • Most results will match the ratings details. However, additional subgroups are present here. • Important Note: English Learners is ever-EL here. On the ratings details it is current EL or exited within the previous two years.

27. Outcomes (High) • Includes completion and college/career readiness indicators. • Freshmen on track submitted by districts. • SAT data is from the College Board (not yet available) • Continuing education is from the National Student Clearinghouse

28. Outcomes (High) • Shows 2012-13 graduation/dropout indicators by subgroup. • Students are EL for On Track, Graduation and Completion if they were served or eligible at any time during high school. This is the one place that “Ever EL” is not used. • Includes Oregon performance for each subgroup, and how the school compares to the state average for that subgroup. • State On Track numbers not yet available.

29. Curriculum & Learning Environment This is page three of the Elementary school prototype. High schools and middle schools have additional categories. Priority, Focus, and Model will have Title 1 information at the bottom.

30. District Report Card Redesign Detailed Review of Data Included

31. Validation Notes This front page will only show during the preview window. It will not be included in the public release. It will contain information pertinent to each preview.

32. District Report Card Redesign This is page one of the district prototype. All prototypes are available at: http://www.ode.state.or.us/search/page/?id=3881

33. Letter from the Superintendent • Provided to ODE via the Supplemental Data Collection. • English and Spanish translations must be provided. • Header data comes from our Institutions database.

34. District Profile • Data comes from 3rd Period Cumulative ADM. Gives a “May 1” snapshot of the district. • English Learners –reported as EL at any time in Oregon (since 2006-07). • Students attending 90% or more days aligns to “Chronically Absent” measure on Achievement Compacts. • Student wellness and racial equity submitted by districts.

35. Report Card Redesign Page two of the district card is a continuation of the district profile on page 1. Expulsions data will be on the preview. All prototypes available at: http://www.ode.state.or.us/search/page/?id=3881

36. Progress • Shows assessment performance for the last four years. • Includes student enrolled on May 1 that were full academic year in the district. • Data is broken down by grade spans. • Includes Oregon and Like-District values for 2012-13. • Participation rate won’t be checked on the first preview.

37. Outcomes • Includes completion and college/career readiness indicators. Matches the high school reports. • Freshmen on track submitted by districts. • SAT data is from the College Board (not yet available) • Continuing education is from the National Student Clearinghouse • 2009-10 Completion and Continuing Education data is not available.

38. Outcomes • Shows 2012-13 graduation/dropout indicators by subgroup. • Students are EL for On Track, Graduation and Completion if they were served or eligible at any time during high school. This is the one place that “Ever EL” is not used. • Includes Oregon performance for each subgroup, and how the district compares to the state average for that subgroup. • State On Track numbers not yet available.

39. Curriculum and Learning Environments • Submitted in the supplemental data collection. Spanish must also be submitted.

40. Federal Title 1 Designation • Shows the number of priority, focus, and model schools in the district.

41. Questions?

42. Useful Links • Report Card Page: http://www.ode.state.or.us/search/page/?id=3881 • Assessment Inclusion Rules • Report Card Technical Manual • District Training Site: https://district.ode.state.or.us/search/page/?id=226 • ESEA Waiver: http://www.ode.state.or.us/go/nextgen • Assessment Reporting Schedule: http://www.ode.state.or.us/wma/teachlearn/testing/schedules/asmtreportsched1213.pdf • Application Assistance: ode.helpdesk@state.or.us

43. Contacts • ESD Partners: http://www.ode.state.or.us/wma/teachlearn/testing/oaks/esdpartners1213.pdf • Report Card and RC Validations in general • Jon Wiens: jon.wiens@state.or.us • Josh Rew: josh.rew@state.or.us • Assessments • Cindy Barrick: cindy.barrick@state.or.us • School and District Profiles • Isabell Jacoby: isabella.jacoby@state.or.us • Cumulative ADM • Joy Blackwell: joy.blackwell@state.or.us • Highly Qualified Teachers • Anna Haley: anna.haley@state.or.us