1 / 24

Why Assessment Results Are Hard to Use

Why Assessment Results Are Hard to Use. (and what to do about it). Hi…I’m the Assessment Director. The Theory. What Could Go Wrong?. Look familiar?. Assessment Design. Choosing an Achievement Scale. Pick a scale that corresponds to the educational progress we expect to see. Example:

sidney
Download Presentation

Why Assessment Results Are Hard to Use

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Why Assessment Results Are Hard to Use (and what to do about it)

  2. Hi…I’m the Assessment Director

  3. The Theory

  4. What Could Go Wrong?

  5. Look familiar?

  6. Assessment Design

  7. Choosing an Achievement Scale Pick a scale that corresponds to the educational progress we expect to see. Example: 0 = Remedial work 1 = Fresh / Soph level work 2 = Jr / Sr level work 3 = What we expect of our graduates

  8. Subjective measurements • Use authentic data that already exists • Sacrifices reliability for validity • Create subjective ratings in context • Sacrifices reliability for validity • Assess what you observe, not just what you teach! • Recovers some reliability For complex goals like general education: www.coker.edu/assessment

  9. Survey Attitudes and Behaviors • CIRP, BCSSE, Student satisfaction inventory • Link student ID numbers to other indicators • These can be easily and productively outsourced

  10. Analysis and Reporting

  11. Some Tools • ANOVA • Logistic Regression and ROC curves • http://statpages.org/logistic.html • Pivot tables

  12. Longitudinal Analysis

  13. Use data you already have • Grades • FAFSA, SAT, ACT items • Demographic data • ePortfolio statistics or work • Library circulation statistics

  14. Analysis: Example

  15. You don’t have to average • Measurement requires: • Units • Ability to aggregate • What we actually do is estimation • Without measurement we shouldn’t average

  16. Averages

  17. Proportions

  18. Min / max

  19. Confidence Intervals

  20. Portfolio analysis: epic FAIL!

  21. Analysis: Example

  22. Proportions

  23. Conclusions • Design it yourself • Use a sensible longitudinal scale • Combine with other data • Avoid averages

  24. Last Requests? highered.blogspot.com

More Related