1 / 58

OVERVIEW OF CURRICULUM-BASED MEASUREMENT AS A GENERAL OUTCOME MEASURE

OVERVIEW OF CURRICULUM-BASED MEASUREMENT AS A GENERAL OUTCOME MEASURE. Mark R. Shinn, Ph.D. Michelle M. Shinn, Ph.D. Lisa A. Langell, M.A., S.Psy.S. AIMSweb in a Picture and a Sentence.

Download Presentation

OVERVIEW OF CURRICULUM-BASED MEASUREMENT AS A GENERAL OUTCOME MEASURE

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. OVERVIEW OF CURRICULUM-BASED MEASUREMENT AS A GENERAL OUTCOME MEASURE Mark R. Shinn, Ph.D. Michelle M. Shinn, Ph.D. Lisa A. Langell, M.A., S.Psy.S.

  2. AIMSweb in a Picture and a Sentence AIMSweb is a 3-tier Progress Monitoring System based on direct, frequent and continuous student assessment which is reported to students, parents, teachers and administrators via a web based data management and reporting system for the purpose of determining response to instruction.

  3. CBM is a GOM Used for Scientific Reasons Based on Evidence Reliable and valid indicator of student achievement Simple, efficient, and of short duration to facilitate frequent administration by teachers Provides assessment information that helps teachers plan better instruction Sensitive to the improvement of students’ achievement over time Easily understood by teachers and parents Improves achievement when used to monitor progress

  4. Things to Always Remember About CBM Designed to serve as “indicators” of general reading achievement: CBM probes don’t measure everything, but measure the importantthings. Standardized teststo be given, scored, and interpreted in astandard way Researchedwith respect to psychometric properties to ensure accurate measures of learning

  5. Skill Areas Currently Assessable via AIMSweb: • Early Literacy[K-1 benchmark, Progress Monitor (PM) any age] • Letter Naming Fluency • Letter sound fluency • Phonemic Segmentation Fluency • Nonsense Word Fluency • Early Numeracy (K-1 benchmark, PM any age) • Oral Counting • Number identification • Quantity discrimination • Missing number • Oral Reading (K-8, PM any age) • MAZE (Reading comprehension); (1-8, PM any age) • Math Computation (1-6, PM any age) • Math Facts (PM any age) • Spelling (1-8, PM any age) • Written Expression (1-8, PM any age) • Early Literacy and Oral Reading—Spanish (K-8)

  6. Big Ideas of Benchmark (Tier 1) Assessment Benchmarking allows us to add systematic Formative Evaluation to current practice. • For Teachers (and Students) • Early Identification of At Risk Students • Instructional Planning • Progress Monitoring • For Parents • Opportunities for Communication/Involvement • Accountability • For Administrators • Resource Allocation/Planning and Support • Accountability

  7. Benchmark (Tier 1):3x per year Strategic Monitoring (Tier 2):1x per month for select studentsat risk for educational difficulties(Optional) Progress Monitor (Tier 3):Intensive assessment with adjustable frequency that matches need

  8. Managing Data after Assessment is Easy: • After completing assessment, quickly type data in system. • AIMSweb instantly generates multiple reports for analysis and various decision-making purposes. A few of the many reports available appear here: SAMPLES

  9. Tier 1: Benchmark • Three times per year for all students. • Fall: SeptemberWinter: JanuarySpring: May

  10. For Teachers: Classroom Report

  11. Box & Whiskers Graphs (box plots): A Brief Explanation AIMSweb commonly uses box plots to report data. This chart will help familiarize yourself with box plots: Consider bell-curve. Box plots are somewhat similar in shape and representation. outlier 90th percentile Above Average Range 75th percentile Median (50th percentile) 25th percentile Average range of population included in sample. Below Average Range 10th percentile

  12. Report Beginning of Year Status

  13. Individual Report: Student

  14. Know When Things are Working

  15. Have Data to Know When Things Need Changing

  16. Data to Know that Changes Made a Difference

  17. Identifying At Risk Students

  18. Tier 2: Strategic Monitor (Monthly) Provides option to increase assessment frequency for select students who have been identified as at-risk in the Benchmark process – or for all students if desired.

  19. At-a-Glance Views of Student Ranking & Growth

  20. Follow student progress over time.

  21. Compare Sub-group Trends:

  22. Compare a School to a Composite

  23. Compare Yearly Improvement Progress by 50th Percentiles

  24. Compare Average Student Performance by Benchmark & Across Years

  25. View Growth Trends by Grade and Benchmark Period; View by Comparison Group & Across Years

  26. Compare Average Performance by Sub-Group • Compare by: • Service Code • Ethnicity • ELL/ESL • Meal Status • Various targets

  27. School Reporters may also view data by Grade Level:

  28. School Reporters May View By Grade Level Data: Options Shown Below

  29. View Data by Scores and Percentile Rank per Grade Level within a school or by specific Classroom

  30. Convert Tables to Chart formats

  31. View by:

  32. National Normative Data

  33. National Normative Data

  34. Small Sampling of District-Level Reports

  35. Customer-Level Reports (Multi-District)

  36. Compare Your School to Various Composite Groups, By Grade:

  37. Progress Monitoring Strategies for Writing Individual Goals in General Curriculum and More Frequent Formative Evaluation Mark Shinn, Ph.D.Lisa A. Langell, M.A., S.Psy.S.

  38. Big Ideas About Frequent Formative Evaluation Using General Outcome Measures and the Progress Monitoring Program One of the most powerful interventions that schools can use is systematic and frequent formative evaluation. Benchmark Assessment is not enough for some students because they may be in ineffective programs too long. (3 mos +) The solution is to write individualized goals and determine a feasible progress monitoring schedule. The core of frequent progress monitoring is: Survey-Level Assessment Goal setting using logical educational practices Analysis of student need and resources for determining progress monitoring frequency.

  39. With Very Low Performers, Not Satisfactory to Wait This Long!

  40. Formative Evaluation of Vital Signs Requires Quality Tools Technical adequacy (reliability and validity); Capacity to model growth (able to represent student achievement growth within and across academic years); Treatment sensitivity (scores should change when students are learning); Independence from specific instructional techniques (instructionally eclectic so the system can be used with any type of instruction or curriculum); Capacity to inform teaching (should provide information to help teachers improve instruction); Feasibility (must be doable).

  41. Thinking About A Student’s Data Sample Student: Melissa Smart 3rd grade student Progress Monitor

  42. 8 Melissa Smart 110 92 77 50 34

  43. Formative Evaluation—Is simply data enough?

  44. Formative Evaluation: Is data and a goal enough?

  45. Formative Evaluation: Are data, goals & trends enough?

More Related