1 / 4

Understanding Rater-to -Rater Reliability A Closer Look At Standards I through IV

Understanding Rater-to -Rater Reliability A Closer Look At Standards I through IV Rubric and Observation. Activity: Self-Assessment. On a scale of 0-5, with 0 being the lowest ...

hagen
Download Presentation

Understanding Rater-to -Rater Reliability A Closer Look At Standards I through IV

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Understanding Rater-to-Rater Reliability A Closer Look At Standards I through IV Rubric and Observation

  2. Activity: Self-Assessment On a scale of 0-5, with 0 being the lowest... Where do you think you and your colleagues are on the continuum of having consistency in marking each element on the teacher observation instrument? What evidence can you provide? Base your response on what you currently know about Rater-to-Rater Reliability.

  3. Rater Errors to Avoid Similarity Rating influenced by how similar the observed classroom or school is to yours, how similar the practice observed is to yours, or how similar the person being observed is to you. Leniency Rating higher than deserved to give the person the "benefit of doubt." Halo Rating on one dimension determined by rating on another.

  4. Rater Errors to Avoid Central Tendency Rating everyone in the middle; often due to "anchoring" on the middle level by assuming that everyone is average (or proficient) unless there is a lot of evidence he/she is not. Consistency/Confirmation Looking for evidence for pre-judgement or a judgement based on one's initial impression. Context Effects Performance of peer group influences ratings.

More Related