2009-2010 Site Assessment Leader Training - Benchmarks - Welcome to a New Year!!

1. 2009-2010Site Assessment Leader Training- Benchmarks -Welcome to a New Year!! Today’s Topics: I. Test Development II. Test Administration III. After the Test

2. Purpose Information to Share • Purpose: • Provide information to guide instruction by measuring student proficiency on state standards and curriculum learning objectives • Secondary Purpose: • Measure student growth Test Development

3. TestDevelopment Information to Share • Industry standard process • Developed by teachers and facilitators with the support of central office. • Yearly item-analysis and revision • Reviewed by teachers and facilitators. • Alignment • 2-5 Math: Aligned to Learning Goals in the Curriculum • 6-8 Math & 2-8 Literacy: Aligned to State Standards Test Development

4. Item difficulty Information to Share • Item difficulty carefully monitored. • Data from last year’s test • Classroom teachers feedback on difficulty • More easy items on Test 1 v. Test 3. • Rationale: Instructional value • Performance bands set accordingly. Test Development

5. Content Areas Information to Share • Reading and Writing – Grades 2-8 • Spanish versions available (except for Middle School.) • Middle School ELLs (English Language Learners) who cannot access reading and writing tests should take Shining Star ELD tests. • All students must take either Benchmark or ELD test. • Grade 2 – • Spring test is mandatory. • Fall and Winter tests are optional. • Math – Grades 2-8 • Spanish versions available • Grade 2 – • Spring test is mandatory. • Fall and Winter tests are optional. Test Development

6. Information to Share Test Administration: Testing Windows • All Benchmark tests must be administered during the first week of each assessment window. • The second week is reserved for make-ups. Test Administration

7. Test Administration:Which students to test… • All eligible students should be tested. • Special populations to consider • CSAPA eligible students are not required to participate in Benchmark assessments. • ELA students— • Which test will provide the teacher useful instructional information? Test Administration

8. Information to Share Test Administration:Criteria for Spanish version of a Benchmark test • Round 1: Primary guiding questions: • What is the student’s primary language of instruction? • Which version would glean the most useful information for making instructional decisions? • Rounds 2 & 3: Consider the following criteria: • What is the student’s primary language of instruction? AND • Has the student been enrolled in a Colorado public school for less than 3 years (starting in 1st grade)? • Student Growth Objective (SGO) Cautions • e.g., Test 1: Spanish, Test 3: English • Scan only one test per student per content area. Test Administration

9. Test Administration:No Off-Grade Level Testing (e.g., a 3rd grader taking a 4th grade math test) Information to Share • Students must take the test that corresponds to the grade level in which they are enrolled • Students receiving off-grade level instruction • Can take off-grade level test second, but it can not be scanned into Edusoft Test Administration

10. Test materials preparation • Gathering/organizing materials • Printing answer sheets • Test Security Measures • System for distributing/collecting materials Test Administration

11. Testing Materials Information to Share • Student Materials • Student Test Booklets (secure documents) • Multiple Choice Answer Sheets • Teacher Materials • Teacher Editions (secure documents) • Procedures Manual • Administration Instructions • Constructed Response Answer Sheets • Summary Sheet • SAL Materials • Summary Sheet • Testing Lists • Request for Additional Materials Form Test Administration Return to Table of Contents

12. Information to Share TestBooklets When students receive their test booklets, they must complete the blank lines on the front cover. Test Administration

13. Answer Sheets Information to Share • Student answer sheet • MC only • Accommodations • DO NOT use English answer sheets for Spanish tests • Teacher answer sheet • CR only • Transcribing • Highly recommended for 2nd Grade, Test 1 (29% non-response on Test 1) Test Administration

14. Information to Share Answer Documents Students must write their first and last name on the line provided. -and- Students must mark the bubble next to their name. Test Administration Teacher bubbles accommodations provided for student. Note: Constructed response items will appear on a separate page for students in grades 2-8.

15. Proctoring vs. Teaching Information to Share • Teachers’ goal – student learning. • Individualize support for students at different levels. • Proctors’ goal – consistent testing environment (standardization). • Provide a uniform testing experience for all students. • Monitor your “teacher” instincts when proctoring. Test Administration

16. Information to Share Proctoring suggestions What happens in your room should be exactly what happens in all other testing rooms. • Do’s • Familiarize: Know what’s required • Directions: Word for word! • Cover/remove classroom material that could give answers. • Active Proctoring • Know what’s happening in the room at all times. • Don’ts • No hints • “Do your best.” • No prompting to complete or change answers. Test Administration

17. Test Administration: Teacher Tips Information to Share • Motivating Students • Seating charts • Content decisions • Others? • Specific to Test 1 • Let students know material will be challenging • 2nd Grade: Practice • Bubbling • Editing Test Administration

18. Test administration formats Make sure your teachers have the Administration Instructions for the tests they are administering. (NOT just the Teacher Edition) • Reading • Grade 2: Two 30-minute sessions • Grades 3-8: One 70-minute session • Writing • Grade 2: Two 25-minute sessions • Grade 3-8: Two 45-minute sessions • Math • Grade 2: One 45-minute session • Grades 3-8: One 60-minute sessions Test Administration Find detailed information in the Manual.

19. Test security Information to Share • Before: SAL • Store in a secure location • During: Test administrator • No scratch paper except for Writing Test • Reminder: CSAP does NOT allow scratch paper • No cell phones • After: SAL • Test materials must be returned to the Test Processing Center one month after testing has concluded • Allowed to keep one blank Teacher Edition from each test in a secure location Test Administration

20. Information to Share Scoring – constructed response • “Potential Minimum Full Credit Response” • Not exhaustive • Use professional judgment. • Benefits of collaborative scoring • More accurate scores • 2008-2009 Correlation Reports in School Folders • correspondence with CSAP • Recording scores • On separate sheet for class. After the Test

21. Scanning I • Prevent mis-scans • Student names bubbled • No stray marks, folds, tears or tape • Benefits of “Auditing” – Prevent misleading information • Look for • missing grade levels and/or content areas • students with only half of the test (either MC or CR) scanned • Use checklist forms on A&R site – view forms • Be aware of scanning deadlines – view due dates After the Test

22. Answer Sheets Answer Sheets Answer Sheets Answer Sheets Answer Sheets Answer Sheets Third Grade Reading Tests Third Grade Writing Tests Divider Sheet Divider Sheet Divider Sheet Divider Sheet Divider Sheet Returning Benchmark Materials All benchmark test materials, including completed tests, must be returned to the processing center within one month after the administration window closes. Fourth Grade Writing Tests • Begin by placing all unused materials and additional resources at the bottom of the last box. • Place a divider sheet on top of the unused materials. • Choose one content area from the highest grade level in the school. Pack all completed answer sheets then all completed tests. • Place a divider sheet and pack the next content area. • Pack the next highest grade. • The Processing Center will provide green labels for all boxes used to return test materials. Fourth Grade Math Tests After the Test Third Grade Math Tests Unused Materials Fourth Grade Reading Tests

23. Scanning II: Reminders • Scan only one answer sheet per student per content. • Different languages • Off-grade level • Invalidated tests cannot be scanned. • e.g., non-standardized administrations After the Test

24. Information to Share Checklist Forms for Auditing SAL Checklist Teacher Checklist After the Test

25. Test results—Instruction! Information to Share • For teacher • Test 1: Plan areas of emphasis/focus • Test 2: How’d I do? What must be revisited? • Test 3: Looking to next year… • Use caution when comparing performance on assessment objectives/frameworks! (Small number of items = less reliable score!) • For students • Test 1: Preview of year’s content • Set individual goals (motivational) • Tests 2 & 3: Review progress and adjust individual goals After the Test

26. Test results—Growth Information to Share • SGO’s (Student Growth Objectives) • Test 1 and Test 3 • Only performance bands (not raw score or percent correct) • Test 1 vs Test 3 • More easy points on Test 1 • Reason: Instructional information • Difficulty corrected with performance bands • Set using end-of-year expectations for both tests. After the Test

27. Resources: Assessment and Research Website Information to Share http://testing.dpsk12.org/ BenchmarkLink Message Board Scoring Resources Staff Directory

28. Questions Related To… Information to Share • Administration • Assessment & Research website http://testing.dpsk12.org/ • Assessment Instructional Specialists • Assessment & Research hotline: 720.423.3736 • Assessment Materials • Processing Center Phone: 720.423.4260 • Processing Center Fax: 720.423.4269 • Edusoft Website • Kari French: Kari_French@dpsk12.org 720-891-0544 • Feedback • Feedback regarding the Benchmark Assessment Program is strongly encouraged and appreciated. Please direct all comments & concerns to Steve Lehman or Teresa Hernandez.

29. Resources What do I need to know…and where do I find it? • Who do I contact for help when I have a question? • Network Assessment Specialists • Network 1: Kate Greeley • Network 2: Katie Shaw • Network 3: Suzie Moore • Network 4: Lee Cooper • Network 5: Kim Nusbaum • K-8 Network : Sharon Hicks • Middle School Network: Kent Epperson • HS Network: Ann Cobb • Assessment & Research support – A&R directory • Processing Center– A&R directory • EduSoft:Kari Frenchkari_french@dpsk12.org • When are Assessments Given? • 2009-2010 Testing Calendar