Mississippi Principal Evaluation System (MPES)

1. Mississippi Principal Evaluation System (MPES) Advisory Board September 24, 2013

2. I. Introduction • Welcome • Introductions (SECC at SEDL, RCU) • Please hold questions until after each section. • MPES Update: • 1,461 principals in Canvas • 1,050 goal forms (Forms 2A-C) received to date • Major challenges thus far: Login process, goal-setting questions, Canvas downtime

3. GOTO Participant Window Expand/Collapse Control Panel Raise Hand Icon Mute line option

4. II. MPES Circle Survey • Survey comprises 30% of Summative Assessment Score for principals • MDE will provide one survey option free of charge • MDE survey tool will be ready for testing late October; survey tool goes live January 2014 • 3 components: Certified Staff (10%), Principal (10%), and Supervisor (10%) • All certified staff will participate in the survey • Concise, secure, online survey (should take 30 min.)

5. Circle Survey Process • Survey may be completed at each participant’s convenience or in a lab setting • Survey score will align with the MPES 1-4 rating system • MPES Advisory Board training on the tool will take place in November • Webinar training for MPES participants will occur in January-February

6. Circle Survey Process, Cont. • Anonymous staff component • Districts will receive an assigned ID code for each principal being evaluated. • Districts will be responsible for deciding how to distribute the principal ID code and the randomly assigned, one-time-use login IDs to certified staff in each school. • The RCU will help facilitate this process as much or as little as the district wants.

7. Circle Survey Process, Cont. • How will the secure login information be randomly assigned to certified staff? • District level staff will distribute login information to the schools. • Districts may choose the best methods for them: 1. Fishbowl method—login IDs are randomly selected by each qualified participant. 2. Login IDs are randomly generated and given to a district for distribution among schools.

8. Circle Survey Process, Cont. • Security seems to be the key concern of MPES participants. • The principal and the MDE officials assessing survey results will have no way to link a specific login ID to a specific staff member within a school.

9. Circle Survey Questionnaire • Drafted Circle Survey questions have been provided for you. Please consider: • Are questions clear? • Are questions appropriately categorized? • Are questions applicable to principals, assistant principals, CTE directors, and alternative school principals? • Our goal is to reduce the survey to approx. 30 questions using focus groups—please send us your initial feedback about which questions to remove and/or revise.

10. Circle Survey Alternatives • MDE has established that the Circle Survey and alternative tools must be valid, reliable, and research based. • A minimum of 4 tools must be offered; districts may choose their preference. • The RCU will provide recommendations to MDE based on available tools and data.

11. Circle Survey Alternatives, Cont. • RCU researchers are looking at factors such as availability, cost, validity, reliability, etc. • Tools being studied include options like: • Diagnostic Assessment of School and Principal Effectiveness • Performance Review Analysis and Improvement System for Education (PRAISE) • Principal Instructional-Management Rating Scale (PIMRS) • Vanderbilt Assessment of Leadership in Education (VAL-ED)

12. Future Considerations • The first year is devoted to data gathering. Issues to consider in the future may include: • Minimum participation rate • Minimum population size • How to handle schools that do not achieve the minimum requirements

13. Circle Survey Questions • What questions do you have? • What questions are MPES participants likely to have?

14. Circle Survey Contacts

15. III. MPES Evaluation Plan • MPES evaluation goals • Data sources and collection activities • MPES Evaluation goal-setting survey

16. MPES Evaluation Goals The evaluation will explore whether the MPES: • accurately measures principal effectiveness • is cost effective and efficient • encourages best practices among school leaders

17. 1) Accurately Measuring Principal Effectiveness • Analysis of scores within different measures • Reliability and Validity • Analysis of variance in scores • Analysis of scores across different measures • Alignment of different measures

18. 2) Cost Effectiveness and Efficiency • Ease of use • Resource use • Implementation fidelity • Personnel evaluation standards

19. 3) Encourages Best Practices • Identifies principals’ strengths and areas needing improvement • Identifies principals’ professional development needs • Instruction and learning improve

20. MPES Evaluation Goals The evaluation will explore whether the MPES: • accurately measures principal effectiveness • is cost effective and efficient • encourages best practices among school leaders Are these important goals for the evaluation? If not, why not?

21. MPES Evaluation Goals The evaluation will explore whether the MPES: • accurately measures principal effectiveness • is cost effective and efficient • encourages best practices among school leaders Are there other issues we should explore in evaluating the MPES?

22. Proposed MPES Data Collection • Goal-Setting Survey: Fall 2013 • Goal Data Analysis: Fall 2013 • Year-End Survey: Summer 2014 • Score Analysis: Summer 2014

23. Proposed MPES Data Collection • Goal-Setting Survey: Fall 2013 • Goal Data Analysis: Fall 2013 • Year-End Survey: Summer 2014 • Score Analysis: Summer 2014 Will these data sources provide critical information? Why or why not?

24. Goal-Setting Survey • Items asking about satisfaction with: • Goal-setting training • Goal-setting process • Canvas • Buy-in for MPES by supervisors (principals) and buy-in from principals (central office)

25. Goal-Setting Survey • Items asking about satisfaction with: • Goal-setting training • Goal-setting process • Canvas • Buy-in for MPES by supervisors (principals) and buy-in from principals (central office) What suggestions would you make for improving the Goal Setting Surveys?

26. Goal-Setting Survey • Goal-Setting Survey: Fall 2013 • Distribution (Poll) • Sampling (Poll) • Timing of Survey (Poll)

27. Evaluation Plan Questions • What questions do you have? • What questions are MPES participants likely to have?

28. SECC Evaluation Plan Contact

29. IV. MPES Updates • ESEA waivers • MDE accountability model • Alternative principals • Professional development

30. ESEA Waivers • Educator-evaluation waiver • Personnel decisions: 2016-17 • Excellence for All pilot • Double-testing waiver

31. MDE Accountability Model • Proposed changes to student growth model • Single model (state/federal) • State Board of Education

32. Alternative Principals • Diverse missions • Optional participation 2013-2014 • Focus group

33. Professional Development • Goal Training for District Administrators • Fall 2013 • Goal-implementation process • Southern Mississippi RSEA

34. V. Conclusions and Wrap-up • MDE “To Do” list • Next meeting – second week of November • Circle Survey Tool Unveiled • Update on MPES Implementation Survey • Suggestions/feedback related to agenda are welcome • Format for next Advisory Board meeting (Poll)

35. Overall MPES Questions • What questions do you have? • What questions are MPES participants likely to have?

36. MDE Contact www.mde.k12.ms.us/federal-programs Select MPES on the left side of the page.