1 / 11

Summary of Findings: Reliability

Summary of Findings: Reliability. Relationship between SPS Overall Percent Favorable and Overall Evaluation Rating . What about the survey elements? . Classroom Community. Classroom Management. Student Learning. Student-Centered Environment. Summary of Findings - Validity.

shawn
Download Presentation

Summary of Findings: Reliability

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Summary of Findings: Reliability

  2. Relationship between SPS Overall Percent Favorable and Overall Evaluation Rating

  3. What about the survey elements? Classroom Community Classroom Management Student Learning Student-Centered Environment

  4. Summary of Findings - Validity • Analyzed 14,539 open-ended responses (3-5 and 6-12) • We find that not only were the majority of students taking the survey seriously, but that many of the responses were specific and actionable in nature • 98.6% (N=14,341) were considered substantive • 66.3% (N=9,646) were coded as actionable • Moreover, although some subjects and grades were slightly more likely to garner actionable feedback, in general actionable responses came from students in all grades and subjects

  5. What Students are Saying About Teachers Overview of Student Feedback for Teachers

  6. Guiding principles for administration • We know that teachers care about their practice and especially about their students. • They also may experience nervousness and anxiety about the surveys, and district and school leaders must address those fears. • By itself, a reliable and valid instrument does not ensure that teachers will receive good feedback. • Messaging matters! • Engage stakeholders early and often • Make the process as transparent as possible • Give stakeholders real decision-making power

  7. Engaging Stakeholders • Forming a planning committee • Building educator investment • Building student understanding and comfort • Informing other stakeholders

  8. Key Decisions • Use a vendor or manage administration internally? • Online or paper/pencil survey administration? • When will the survey be administered? • How will students and teachers be sampled? • Include an open-ended question on the survey? • How will survey results be used?

  9. Key Decision: How will survey results be used? • Consider a “hold-harmless” pilot year • As a formative tool • Reflect on individual practice • Identify over-arching trends and create strategies to address them. • As a part of an evaluation • Used as an artifact for determining ratings for professional practices • Included as one of several multiple measures • Sharing teacher-level results

  10. Contact Information Colorado’s Student Perception Survey Website: www.colegacy.org/studentsurvey Amy Farley, Director, Research and Impact 720-502-4723 afarley@colegacy.org

  11. Elaine Allensworth, Consortium on Chicago School Research elainea@uchicago.edu Amy Farley, Colorado Legacy Foundation afarley@colegacy.org Kendra Wilhelm, Denver Public Schools Kendra_wilhelm@dpsk12.org Questions? @AYPF_Tweets #aypfevents

More Related