Universal Screening: Materials, Administration, Scoring & Data Entry

1. Universal Screening: Materials, Administration, Scoring & Data Entry TFA August 4, 2010 RCPS

2. Universal Screening • All Students • Method for Identifying those needing support

3. Universal Screening • General Outcome Measure – used in all walks of life. • Quick and Efficient • …but accurate • Don’t measure everything • …but important things • Repeated Administrations • Measures growth over time • On tasks of equivalent difficulty

4. But… • Combined with other sources of data • SOL performance • Developmental Spelling Assessment • And others? • Goals • Accurately identify students needing additional help • Determine the type of instruction they need

5. Universal Screeners • Can be used to assess many types of skills • 3-5th grade = Standards of Learning • Fluency and Comprehension • Primary method for measuring comprehension • Maze Procedure • Primary method for measuring fluency • Oral Reading Fluency (ORF)

6. Multi-Layered Approach • Step 1 – All 3-5 students assessed on AIMSWEB Maze (Comprehension) • Step 2 – Assess indicated students on AIMSWEB R-CBM (Fluency)

7. Screening Schedule • 3 xs per year • Fall (First 2 weeks of September) • Winter (First 2 weeks of December) • Spring (First 2 weeks of April) Why 3xs per year?

8. Universal Screener • Maze Procedure • Student is required to correctly identify missing words (multiple choice) from a passage as he/she reads. • Every 7th word is replaced with 3 choices. • One choice = near distracter & other choice is a far distracter. • Positive correlation with SOL Reading Scores

9. MAZE EXAMPLE

10. Before You Start • Can be administered to whole class, small group, or one on one. • Materials needed: • Reading passages • Scoring Template • Cover sheet/practice test • Pencil • Stopwatch or timer

11. Maze AdministrationSOP is in Effect!

12. Maze Administration

13. Maze Administration

14. Maze Administration

15. Keep in Mind • Data will be collected from 3 passages per benchmark period. • Same 3 passages are used at each benchmark period. • Remind students to circle their answers • If interruptions occur – discard the passage, administer a new one. • Student is unmotivated to perform, please note. Attempt to obtain best effort.

16. Maze Scoring • Count all correct items • Circled responses match the scoring template. • Count each accurate item as one correct. • Count all errors • Circled item does not match the template. • Responds to items after 3 minutes. • Place a slash through incorrect items. • On the cover sheet • Record total correct • Record total incorrect • Place scores on the “Screening Roster”

18. What if a Student Finishes Early?

19. Oral Reading Fluency • What is it? • Student is asked to orally read short passages for one minute. • What does it measure? • Ability to quickly and accurately orally read connected text.

20. Step 1 When I say begin, start reading aloud at the top of this page. Read across the page (demonstrate by pointing). Try to read each word. If you come to a word you do not know, I’ll tell it to you. Be sure to do your best reading. Are there any questions (Pause). Begin. Step 2 Start stopwatch after student says first word. Step 3 Place a (/) through incorrect words. Step 4 Stop the stopwatch at the end of one minute.Place a bracket after last word read. Oral Reading Fluency Administration Student has a clean passage

21. Oral Reading Fluency Scoring Errors • Rule 1 – • Three second rule. If a student hesitates or struggles for 3 seconds, tell the student the word and mark it as incorrect. • Rule 2 – • Mispronunciation – Student does not read the word correctly considering the context (“It was a live fish” but student says “It was a liv fish”). • Rule 3 – • Omitted Words - Omitted words are scored as incorrect. Count one error for each word omitted.

22. Oral Reading Fluency Scoring Not Errors • Rule 4 – • Repeated Words: Student correctly reads a word but repeats the correct word. This is not counted as an error. • Rule 5 – • Articulation and Dialect: The student is not penalized for imperfect pronunciation due to dialect, articulation, or second language interference (e.g. “bald” for “boiled”). • Rule 6 – • Inserted Words: Inserted words are ignored and not counted as errors (e.g. “The house” is read as “The big house”). • Rule 7 – • Self Corrections: A word is scored as correct if it is initially mispronounced but the student self-corrects within 3 seconds. Mark SC

23. Oral Reading Fluency Scoring Additional Scoring Features • Rule 8 – • Hyphenated Words: Hyphenated words count as 2 or more words if each part can stand alone as a word (e.g. mother – in – law). Hyphenated words count as one word if either part cannot stand alone as one (re-evaluate). • Rule 9 – • Word Order: To be correct, all words must be read in correct order. • Rule 10 – • Discontinue Rule. No words correct in first five words? STOP and record a score of 0 on the front cover. • Rule 11 – • Numerals: Numerals must be read correctly. (e.g. 36 = thirty-six NOT three six).

24. Practice Administrations

25. Keep in Mind • 3 administrations will occur at each benchmark. • Median score is to be reported. • Scores can be placed in student booklets and on the “Screening Roster”. • Note effort/motivation.

26. Entering benchmark data into aimsweb

27. Data Entry • Step 1 – Log In to AimsWEB • One teacher account per grade level will be established. • All teachers within a grade level will use that one account. • The account will be established and populated by project staff. • Step 2 – Enter Benchmark Scores • Individual teachers will be responsible for entering scores for their own students. • Winter and spring = enter data only for those students you work with during “team time”.

28. Step 1 – Logging in to AIMSWEB After initial log-in the designated teacher will be asked to change the password

29. Step 2 – Enter Benchmark Scores

30. Step 2 – Enter Benchmark Scores

31. Information we need from you • Name • School • Grade teaching • Email address • For one selected lead teacher at each grade level. • Last year’s accounts will be deleted.

32. What you will recieve • The lead grade teacher will receive: • An email with account number, log-in name, & temporary password. • Log in immediately. • Set password. • Share password with other teachers on your team.