1 / 25

MassCUE Evaluators

MassCUE Evaluators. Day 2 – January 12, 2012. Welcome to Day 2. Overnight thoughts… What ’ s confusing? What would you like more information on? Questions for today? Review today ’ s agenda. Team Time. Sharing and Reflecting. Partners Present your indicators thus far (15 min)

keefer
Download Presentation

MassCUE Evaluators

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. MassCUE Evaluators Day 2 – January 12, 2012

  2. Welcome to Day 2 • Overnight thoughts… • What’s confusing? • What would you like more information on? • Questions for today? • Review today’s agenda

  3. Team Time

  4. Sharing and Reflecting • Partners • Present your indicators thus far (15 min) • Respond to reflection questions asked by your partner (15 min) • Switch

  5. Team Time

  6. Questions?

  7. Evidence/Data Collection • Quantitative and qualitative data • Classroom observation, interviews, and work-product review • Focus groups and surveys • Student assessment data • Data sources for secondary analysis • Triangulation among data sources

  8. Identifying your sample • Which students provide your sources of data? • Who do you need to study to respond to your indicators • Who would you like to generalize your findings to? • Is there a difference between your sample and the population you want to generalize to?

  9. Surveys • Creating good surveys • Length • Differentiation (teachers, staff, parents, community, etc..) • Quantitative data • Attitudinal data • Timing/response rates (getting returns!) • www.sun-associates.com/eval/samples/samplesurv.html

  10. Survey Issues • Online surveys produce high response rates • Easy to report and analyze data • Depends on access to connectivity

  11. Focus Groups/Interviews • Focus Groups/Interviews • Teachers • Parents • Students • Administrators • Other stakeholders

  12. Classroom Observations • Using an observation template • Using outside observers

  13. Secondary Analysis • Utilizing existing assessments • MCAS • Other assessments • Thinking about how this analysis fits your indicators • Remember, all data needs to be related to your indicators!

  14. Examples of MCAS Analyses Median student growth percentiles for pilot and comparison student performance 2010 ELA MCAS

  15. Examples of MCAS Analyses (2) The analyses found that the coefficients for both prior achievement (i.e. 2006 ELA score) and participation in the BWLI program were statistically significant (p < .0005 for the ELA 2006 and p = .006 for BWLI). The increase in ELA scores for BWLI students was statistically significant compared to the increase in scores observed for comparison students.

  16. Other Data? • Artifact analysis • A rubric for analyzing teacher and student work? • Student Drawings • Solicitation of teacher/parent/student stories • This is a way to gather truly qualitative data • What does the community say about the use and impact of technology?

  17. Student Drawing Example 1

  18. Student Drawing Example 2

  19. Student Drawing Example 3

  20. Student Drawing Example 4

  21. Your Evaluation Plan • Complete the Indicator Matrix and send it to us by 2/1/12 • Data sources? • Initial ideas for questions? • Thoughts about responsibilities and timeframe?

  22. Team Time

  23. Day 2 Wrap-Up • Questions? • Daily Evaluation • Indicator Matrices due on 2/1/12 to Sun Associates • See you in February!

More Related