Michigan’s Educator Evaluation Systems

1. Michigan’s Educator Evaluation Systems Reflecting Local System Determinations for 2011-12

2. Current Legislative Timelines • What we Know About MI Evaluation Systems • Principal Training Grants • Teacher-Student Data Link (TSDL) Overview

3. Current Legislative Timeline

4. Our current legislation requires local systems of evaluations in 2011-12 & 2012-13 • Gives districts flexibility to design systems that work best for them • Over 800 systems across the state • Varying degrees of implementation across the state (in part due to resources and contracts) • Varying degrees of access to training for evaluators (principals) Current Circumstances

5. How can this new legislation and change be a positive for educators and students? • Establishes targets for student achievement at the student, district, and building level. • Provides measurement of progress toward goals for teachers and students. • Allows teachers and administrators to focus on best practice and continuous improvement. • Helps reaffirm the profession by having a system in place to recognize excellence. • Helped secure Michigan’s approval of ESEA Flexibility which waived many of the unrealistic targets within No Child Left Behind Positive Outcomes

6. Public reporting of effectiveness labels • Scheduled for release in late fall via mischooldata.org • Teachers labels reported in aggregate by school (number of teachers in each of the four categories) • Principals/Administrators reported at the district level There are likely to be misunderstandings about the “results” this year and next year. • Beta year • Varying components • Varying percentages of growth • Some districts on prior contract (i.e. No new system, but reporting labels was required) Current Circumstances: SFSF Requirements

7. While the legislation was in place for local systems of evaluation prior to the law changing in July 2011, the change made it such that the stakes were higher. • And, legislation said systems had to be put into place by September 1, 2011—which meant quick turnaround for some districts who were less prepared or who were planning to use the year to further develop their system. • Many districts were hoping/expecting the MCEE to have a system to put into place by April 30, 2012—so some districts did little to develop, not wanting to duplicate efforts or be told they had to change. Current Circumstances: Beta Year

8. The Law: MCL 380.1249 • While there is some definition, there is GREAT variability in terms of implementation • How multiple measures and other components are to be included are not prescribed • Districts made great efforts to update, revise, and/or overhaul their systems of evaluation to meet the requirements and improve their systems of evaluation to provide targeted feedback and support in order to improve student learning. Current Circumstances: Varying Components

9. Districts Interpreted “Significant” Differently! • Some have 0% growth because they were on prior contracts that did not require it. • Some chose 10% because their prior system included 0% growth, so 10% was a “significant” increase. Additionally, available measures of “growth” are not widely available for all teachers, so integration of these measures is challenging. • Some districts chose 25% since 25% will be the amount when the MCEE’s system goes into place in 2013-14. • Not only, the varying percentages—but evidences of growth vary greatly from district to district. • Common Assessments were retooled to function as pre and post tests. • MDE’s PLC tool results in applicable grades • Portfolio evidence Current Circumstances: Varying % of growth

10. We want to avoid/limit inappropriate comparisons, which means analysis and briefing is critical—and being conducted now at MDE. • Prior to release: • Analysis of labels and K-12 Survey in the form of a Policy Brief or Facts and Figures document by our Strategic Policy Evaluation and Research Unit • Communication to districts regarding the release with these limitations outline to assist in their own communications. • PPT presentation posted on our website for additional information or to by used by districts in their own presentations. So what is MDE going to do?

11. The MCEE will submit to the State Board of Education, the Governor, and the state legislature a report that identifies and recommends all of the following: • A student growth and assessment tool. • A state evaluation tool for teachers. • A state evaluation tool for school administrators. • Changes to the requirements for a professional teaching certificate. • A process for evaluating and approving local evaluation tools for educators that are consistent with the state evaluation tool for teachers and administrators and the act. MCEE’s Charge

12. 5 Dimensions of Teaching and Learning • Clare Public Schools • Leslie Public Schools • Marshall Public Schools • Mt. Morris Consolidated Schools Charlotte Danielson’s Framework for Teaching • Garden City Public Schools • Montrose Community Schools • Port Huron School District MCEE’s Pilot Tools and Districts

13. Marzano Teacher Evaluation Model • Big Rapids Public Schools • Farmington Public Schools • North Branch Area Schools The Thoughtful Classroom • Cassopolis Public Schools • Gibraltar School District • Harper Creek Community Schools • Lincoln Consolidated Schools MCEE’s Pilot Tools and Districts

14. Council Website: www.mcede.org Council Members: • Deborah Loewenberg Ball, MCEE Chair • Joseph Martineau, MDE Designee (nonvoting) • Mark Reckase • David Vensel • Jennifer Hammond MCEE Resources

15. Principal Training Grants Orientation, Process, & Timelines

16. The Law: MCL 388.1695, Sec. 95 • $1.75 million allocated for Principal and Assistant Principal Training for Conducting Educator Evaluations • Assist principals and assistant principals with this work in the second year of educator evaluation implementation Principal Training Grants – 2012-13 SY

17. Applications for Training Programs were accepted in August • Educator evaluation training programs had to meet the following statutory criteria to be considered for approval: • Contain instructional content on methods of evaluating teachers consistently across multiple grades and subjects; • Include training on evaluation observation that is focused on reliability and bias awareness and that instills skills needed for consistent, evidence-based observations; • Incorporate the use of videos of actual lessons for applying rubrics and consistent scoring; • Align with recommendations of the Michigan Council for Educator Effectiveness; and • Provide ongoing support to maintain inter-rater reliability. Training Programs

18. Approved Training Programs

19. NOVEMBER • MEGS+ will open for grant applications by district • Districts will select the training program that they have already signed up for in the 2012-13 school year or plan to sign up for in the 2012-13 school year • Districts will submit the PICs for all principals and assistant principals who have gone through selected training or who will go through the selected training. Application & Award Process

20. DECEMBER • Grant submissions will be verified with the REP submission to ensure that Assignment Codes of those submitted are Principals and Assistant Principals (73100-73399, 74100-74399) • Business rules applied to determine grantees JANUARY • Awards disseminated through School Aid Application & Award Process

21. TSDL Teacher-Student Data Link

22. Data initiative to link each student to the courses he/she took and to the teachers who taught those courses • Required under State Fiscal Stabilization Fund as a deliverable • Will mature in the coming years to be able to provide measures and information over time • Required as a compliance factor in the NEW School Accountability Scorecards for 2012-13 Teacher/Student Data Link

23. Extremely limited, so districts choose which “pieces” make sense in their local context • Generated for each educator of students in tested grades, regardless of subject taught. • BUT “growth”, or Performance Level Change (PLC), exists only for reading and mathematics for MEAP and MI-Access FI in grades 4-8 State-provided measures

24. Teachers are linked to courses • Students are linked to courses • For each course taught, a teacher has a list of students who were reported as taking that course. • Spring assessment data 2011 and fall assessment data 2011 will attribute to teachers from the 2010-2011 school year • “Feeder school” for fall assessment data How does the TSDL Work?

25. Teacher-Student Linked Assessment File(From BAA Secure Site)

26. Once teachers are linked to students, the TSDL file provides: • Performance level change (PLC) for MEAP and MI-Access FI in reading and mathematics for each teacher where available (regardless of subject taught) in grades 4-8. • Performance level in writing, science, social studies, reading and mathematics for each teacher where available (regardless of subject taught) across all tested grades. Linking assessment data to students

27. Performance Level Change “Growth”

28. TSDL User role must be established in the Secure Site to access the data at the district or school level • Spring Assessments/High school link available through the Secure Site as of January. • Fall Assessments (Elementary and Middle) TSDL through the Secure Site as of March. Access to TSDL data

29. District/school performs roster verification on the TSDL file • District/school needs to adjust each list based on rules like: • student attendance • subject taught match • grade taught • other local factors After downloading the TSDL File

30. Sample Components of Evaluation

31. This year, the TSDL provides PLC data linked to teachers to districts for integration into local systems along with an optional tool. • These are general guidelines/suggestions—NOT requirements for reading and math in grades 4-8 Using PLC Data with MDE Tool

32. STEP #1 • Download TSDL file through BAA Secure Site • Apply rules regarding which students “count” toward a teacher’s evaluation (i.e. attendance rules) • Consider de-duplication of records • Paste your modified TSDL data into the Weighted PLC Tool One Possible Method: Using MDE Tool

33. STEP #2 • Determine/Adjust the Weight the PLCs in the tool (calculations automatically adjust/are calculated) • Default weights in the MDE TSDL Weighted PLC Tool: One Possible Method Using MDE Tool

34. STEP #3 • Look at the results at various levels: what is the Weighted PLC at the district, school, grade, and/or subject level? • What is a reasonable Weighted PLC for teachers to show? • Note: Possible range using this Weighted PLC method is from -2 to 2. • The meaning of 0 here is that you’re, on average, maintaining your proficient students. • If using a different weight, it’s necessary to determine the range & meaning of the results. One Possible Method Using MDE Tool

35. In Sunshine School: • The weighted PLC is .643 for math at the school level • Considerations • Positive Weighted PLC = effective • Negative Weighted PLC = minimally effective • Determine threshold for highly effective or ineffective • Set the bar based on the school level—that teachers should at least meet the school level weighted PLC. • For example, for a teacher to be considered effective for this portion of the evaluation, he/she must have a Weighted PLC of .60 or greater. Example: Determining Thresholds

37. To calculate the teacher’s percent of students demonstrating growth, divide Weighted PLC by number of students: 3/8 = .375 • If target for “effective” was .643, this teacher did not meet the “effective” threshold. • BUT, if the target for effective was having a positive Weighted PLC (>0), this teacher would have met it. • Use this as one “growth” component of a multi-measure evaluation system Using weighted PLC and thresholds

38. Paste the modified* TSDL data into the Weighted PLC tool.

39. School Level Weighted PLC = .643

40. PIC (teacher) Level Weighted PLC = 1.33

41. Check it out on the web: • Go to www.michigan.gov/baa and click on the Educator Evaluations tab on the left hand side or click here. Contact Carla Howe with questions: • howec2@michigan.gov or 517-241-2884 Resource and Contact Information