Calling Ms. Cleo:What Can DIBELS Tell Us About the Future

1. Calling Ms. Cleo:What Can DIBELS Tell Us About the Future Ben Clarke, Scott Baker, and Ed Kame’enui Oregon Reading First Center February 3, 2004

2. “The Pleasure of Reading” by Carol Tyx “While part of the pleasure of reading lies in going somewhere else, that’s only one piece of the story. Reading a novel is like watching a potter at work: out of a lump of words, a story emerges. Or maybe it is more like being a potter yourself, the story taking shape right between your hands. As you pull the words up from the page, you see the contours of lives—the curves,the contradictions. It is more difficult to discern the shape of our lives, one chapter overlapping with another. A long read allows us to hold the beginning and the ending of the story in our hands, see the start and the finish at one sitting, and in the process, we touch what is ordinarily too unstable, too shifting to grasp. Momentarily, we witness the shaping power of time. And through that witness, we understand more fully what it means to be alive in time”.

3. Big Ideas of Today’s Presentation • Remembering trajectories: Why they matter. • Reading success is built upon a foundation of skills. • DIBELS provides information about performance today and performance tomorrow. • Educators can use this information to make a difference at the student, classroom, school, and district level.

4. Trajectories: The Predictions • Students on a poor reading trajectory are at risk for poor academic and behavioral outcomes in school and beyond. • Students who start out on the right track tend to stay on it. (Good, Simmons, & Smith, 1998)

5. Longitudinal Outcomes forDIBELS Benchmark Assessment • Odds of achieving subsequent early literacy goals for DIBELS Benchmark Assessments at the beginning, middle, and end of kindergarten, first, second, and third grades (12 screening points across K - 3) are available at dibels.uoregon.edu/techreports/decision_rule_summary.pdf • Students are at risk if the odds are against achieving subsequent early literacy goals. • The purpose of screening is to provide additional instructional support -- strategic or intensive -- sufficient to thwart the prediction achieve reading outcomes.

6. Sample Cutoffs for Low Risk, Some Risk, At Risk for Kinder DIBELS Performance

7. Sample Odds of Achieving Early Literacy Goals for Different Patterns of DIBELS Performance

8. Percentile Rank for the pattern of performance. For example, a child with established ISF, some risk on LNF, and low risk on PSF is at the 54th percentile compared to other children in the middle of kindergarten. He or she achieved as well or better than 54% of children in participating schools on DIBELS. Pattern of performance based on the DIBELS Benchmark Assessment Instructional Recommendations for Individual Patterns of Performance on Middle of KindergartenDIBELS Benchmark Assessment [Table Continues] dibels.uoregon.edu/techreports/decision_rule_summary.pdf

9. Average Percent achieving subsequent early literacy goals. For example, a student with a Deficit, Some Risk, At Risk pattern on DIBELS has 33% odds of achieving later literacy goals on average. Instructional Recommendations for Individual Patterns of Performance on Middle of Kindergarten DIBELS Benchmark Assessment (continued) [Table Continues] Odds of achieving specific early literacy goal. For example, 83% of students with Established, Some Risk, Low Risk pattern in the middle of kindergarten achieved the end of first grade DIBELS Oral Reading Fluency goal of 40 or more words read correct per minute. dibels.uoregon.edu/techreports/decision_rule_summary.pdf

10. Instructional Recommendations for Individual Patterns of Performance on Middle of Kindergarten DIBELS Benchmark Assessment (continued) Incidence or how often a pattern of performance occurs. For example, among students with a Deficit on ISF and Some Risk on LNF, achieving in the At Risk range on PSF would be a more common pattern, but achieving in the Some Risk range would be an unusual pattern. [Table Continues] Extremely rare patterns may indicate a need to retest. For example, it would be extremely rare for a student to have Established ISF, Low Risk on LNF, and At Risk status on PSF. Their PSF score may not be accurately estimating their phonemic awareness skill. dibels.uoregon.edu/techreports/decision_rule_summary.pdf

11. Instructional Recommendations for Individual Patterns of Performance on Middle of Kindergarten DIBELS Benchmark Assessment (continued) [Table Continues] Instructional Support Recommendation. For students with odds in favor of achieving subsequent literacy goals, benchmark instruction is recommended. For students with odds against achieving subsequent literacy goals, intensive support is recommended. For about 50 – 50 odds, strategic support is recommended. dibels.uoregon.edu/techreports/decision_rule_summary.pdf

12. Beginning of Kindergarten

13. Middle of Kindergarten

14. End of Kindergarten

15. Decision Utility of DIBELS • Pattern of performance on DIBELS measures determines overall risk status and instructional recommendation. In fall of first grade, for example, • LNF >= 37, DIBELS PSF >= 35, DIBELS NWF >= 24Instructional Recommendation: Benchmark - At grade level. Effective core curriculum and instruction recommended, • Odds of reading 40 or more words correct per minute at the end of first grade: 84% • Odds of reading less than 20 words correct per minute at the end of first grade: 2% • LNF < 25, DIBELS PSF < 10, DIBELS NWF < 13 Instructional Rec: Intensive - Needs substantial intervention: • Odds of reading 40 or more words correct per minute at the end of first grade: 18% (unless given intensive intervention) • Odds of reading less than 20 words correct per minute at the end of first grade: 48% (unless given intensive intervention) • Value of knowing the instructional recommendation and the goal early enough to change the outcome: Priceless.

16. Instructional Goals for Core Components of Beginning Reading Benchmark Goals to be On Grade Level • Step 1: Phonological Awareness with 25 - 35 on DIBELS Initial Sound Fluency by mid kindergarten (and 18 on PSF) • Step 2: Phonemic Awareness with 35 - 45 on DIBELS Phoneme Segmentation Fluency (and 25 on NWF) • Step 3: Alphabetic principle 50 - 60 on DIBELS Nonsense Word Fluency by mid first grade (and 20 on DORF) • Step 4: Fluency with 40 - 50 on DIBELS Oral reading fluency by end of first grade. • Step 5: Fluency with 90 + on DIBELS Oral reading fluency by end of second grade • Step 6: Fluency with 110 + on DIBELS Oral reading fluency by end of third grade

17. Instructional Steps from Kindergarten to Successful Reading Outcomes The outcome of each step depends on (a) students beginning skills, (b) effectiveness of core curriculum and instruction, and (c) effectiveness of system of additional instructional support.

18. Stepping Stones of Early Literacy Video of Dr. Roland Good

19. Reviewing Outcomes: Effectiveness of Benchmark Instruction (Core Curriculum) • For each step toward literacy outcomes, a school with an effective core curriculum and instruction supports students who are on track (i.e., low risk or benchmark) to achieve the goal. • For students with the odds in favor of achieving literacy goals, it is the job of the core to teach the core components so well that all students achieve the goals.

20. Reviewing Outcomes: Effectiveness of Strategic and Intensive Intervention • For each step toward literacy outcomes, a school with an effective system of effective interventions supports students who are not on track (i.e., at some risk or at risk of difficulty achieving literacy goals) to achieve the goal. • For students with the odds against achieving literacy goals unless we provide an effective intervention, it is the job of the system of additional support to augment the core curriculum so well that all students achieve the same benchmark goals.

21. Step by Step, Core and Intervention Effectiveness of Benchmark (core) for School A AB AS Effectiveness of Strategic support for School A AI Effectiveness of Intensive support for School A

22. Evaluating the Effectiveness of the Core Curriculum and Instruction 1. Is the core curriculum and instruction getting at least 90% to 95% of Benchmark students to the next early literacy goal? • If children are on track, the core should keep them on track. • What would it take to achieve 100%? 2. Is the core curriculum and instruction as effective as other schools in getting Benchmark students to the goal? • If typical schools are not getting 100% of Benchmark students to the goal, then supplementing the core in this area can improve reading outcomes.

24. Middle of first grade outcomes for students with benchmark, strategic, and intensive instructional recommendations in the beginning of first grade Step 3: Beginning First to Middle First AI Intensive Median School Benchmark Median School AB AS A typical (middle) school had 68% of children with a beginning first grade benchmark recommendation achieve the middle of first grade goal, and 0% of children with intensive support recommendation.

25. Step by Step, Core and Intervention Support – Effectiveness is less than a typical school and less than goal. Typical – Effectiveness is less than goal, but typical of other schools. Strength – Effectiveness is at goal or greater than typical of other schools

26. Support Strength Strength Strength Strength Support Typical Strength Typical Step by Step, Core and Intervention Support – Effectiveness is less than a typical school and less than goal. Typical – Effectiveness is less than goal, but typical of other schools. Strength – Effectiveness is at goal or greater than typical of other schools

28. Step 4: Middle First to End First End of first grade outcomes for students with benchmark, strategic, and intensive instructional recommendations in the middle of first grade AB Benchmark Median School AI Intensive Median School AS A typical (middle) school had 96% of children with a middle first grade benchmark recommendation achieve the end of first grade goal, and 0% of children with intensive support recommendation.

29. Support Strength Strength Strength Strength Support Typical Strength Typical Typical Support Typical Step by Step, Core and Intervention Support – Effectiveness is less than a typical school and less than goal. Typical – Effectiveness is less than goal, but typical of other schools. Strength – Effectiveness is at goal or greater than typical of other schools

30. Instructional Steps from Kindergarten to Successful Reading Outcomes Step by step to important reading goals and outcomes. Implicit in this logic is a linkage to High Stakes Reading Outcomes.

31. Third Grade Oral Reading Fluency to Oregon Statewide Assessment Test • Odds of “meets expectation” on OSAT given 3rd grade TORF of 110 : 90 of 91 or 99%. • Odds of “meets expectation” on OSAT given 3rd grade TORF below 70: 4 of 23 or 17%. Exceeds r = .73 53% of Variance Meets Does not meet Expectations

32. Linkage of Third-Grade TORF to Illinois State Assessment Test (ISAT) • Odds of “meets standards” on ISAT given Third-Grade TORF of 110 or above: 73 of 74 or 99%. • Odds of “meets standards” on ISAT given Third-Grade TORF of 70 or below: 1 of 8 or 12%. r = .79 63% of Variance Sibley, D., Biwer, D., & Hesch, A. (2001). Unpublished Data. Arlington Heights, IL: Arlington Heights School District 25.

33. Above 110, the odds are strong the student will rank “proficient” on the AK State Benchmark. Proficient Alaska State Benchmark in Reading Below Proficient Below 70, the odds are low the student will rank “proficient” on the AK State Benchmark. 3rd Grade Benchmark in Reading - CBM Linner, S. (2001, January). Curriculum Based Assessment in reading used as a predictor for the Alaska Benchmark Test. Paper presented at the Alaska Special Education Conference, Anchorage, AK.

34. Linkage of Oral Reading Fluency to State Reading Outcome Assessments Above 110, the odds are 91% the student will rank “adequate” on the FL State Assessment. Below 80, the odds are 19% the student will rank “adequate” on the FL State Assessment. Buck, J., & Torgesen, J. (2003). The relationship between performance on a measure of oral reading fluency and performance on the Florida Comprehensive Assessment Test (Technical Report 1). Tallahassee, FL: Florida Center for Reading Research,.

35. Important Themes • Curriculum and instruction should teach the most important stills that are most predictive of later reading achievement. • It’s not enough to teach -- students must learn what was taught in the program. • All students must learn essential foundation skills.

36. Important themes cont. • All students must perform at high criterion levels of performance on the essential foundation skills. • All students must learn essential skills well enough in time. • If students meet important goals during specific times, we can predict later reading success.