NECAP Science Pilot Test Administration Workshop Grades 4, 8 & 11

1. NECAP Science Pilot Test Administration WorkshopGrades 4, 8 & 11 April 30; May 1, 3, 4 NH Department of Education and Measured Progress

2. NH DOEContact Information Tim Kurtz, Director of AssessmentTKurtz@ed.state.nh.us603.271.3846 Jan McLaughlin, Science Curriculum & Assessment jmclaughlin@ed.state.nh.us 603.271.3856 Gaye Fedorchak, Alternative Assessment gfedorchak@ed.state.nh.us 603.271.7383 Lisa Kaim, Assistant for Math and Science lkaim@ed.state.nh.us 603.271.7450 NH Department of Education, 101 Pleasant Street, Concord, NH 03301-3860

3. Elliot Scharff: NECAP Science Program Manager Phone - 1-603-749-9102 ext. 2126 E-mail - escharff@measuredprogress.org Jennifer Varney: NECAP Science Program Assistant Phone - 1-603-749-9102 ext. 2115 E-mail - jvarney@measuredprogress.org Measured Progress NECAP Science Team NECAP Service Center 1-877-632-7774

4. Measured Progress NECAP Team Mellicent Friddell: NECAP Program Assistant Phone - 1-603-749-9102 ext. 2355 E-mail - mfriddell@measuredprogress.org Tina Haley: NECAP Program Assistant Phone - 1-603-749-9102 ext. 2427 E-mail - chaley@measuredprogress.org Harold Stephens: NECAP Program Director Phone - 1-603-749-9102 ext. 2235 E-mail - hstephens@measuredprogress.org Amanda Smith: NECAP Program Manager Phone - 1-603-749-9102 ext. 2259 E-mail - asmith@measuredprogress.org Joshua Evans: NECAP Program Manager Phone - 1-603-749-9102 ext. 2244 E-mail - jmevans@measuredprogress.org NECAP Service Center 1-877-632-7774

5. The purpose of this workshop is to ensure that • everyone understands the administration procedures for the tests and knows where to find support materials and information. • the NECAP tests are administered in a comparable way in all locations across the three states. • quality control procedures are followed for returning materials.

6. Important Dates (page i) April 30 - May 4: Test Materials and Student ID Labels shipped to schools May 14 - 24: Test Administration Window May 25: UPS pickup of test materials for return to Measured Progress. (Materials need to be ready at 8 a.m.)

7. The New England Common Assessment Program (NECAP) (page 1) Background • Collaboration among New Hampshire, Rhode Island, and Vermont to create a common program • Allows states to combine experience, increase capacity, and share costs • Allows development of a customized science assessment program, which includes an inquiry task component

8. The New England Common Assessment Program (NECAP) (page 1) Purpose of the Pilot Test • Field testing of all items • Try out testing procedures • Opportunity for all schools to become familiar with science testing, including the inquiry task, prior to the May 2008 operational assessment.

9. The New England Common Assessment Program (NECAP) (page 1) Structure of the Science Pilot Test • Students in every school in all three states will take the test. • Each student completes one session of multiple-choice and constructed-response questions and one session of questions tied to an Inquiry Task. • Differences between Pilot Test and Operational Test: • Total testing time • Number of sessions • Make-up tests • Testing window • Reporting

10. Where do NECAP Science Assessment Targets come from?

11. New Hampshire NECAP Information • The NECAP Science Assessment is based on the Science Assessment Targets as designated in the NH Frameworks for Science Literacy K-12. • The designated state (NECAP) assessment targets are the expectations in BOLD boxes in the Science Grade Span Expectations (GSEs). • We use the same “statements of enduring knowledge” to organize our frameworks as the NECAP documents.

12. New Hampshire NECAP Information NECAP Resources on the NH Science Page www.ed.state.nh.us Programs and Services  S  Science in NH Schools NH Science Framework New Hampshire Framework for Science Literacy K-12 (includes all Science Grade Span Expectations) NH Science Grade Span Expectations (includes NECAP targets) K-12 Science Process Skills (includes inquiry targets) K-12 Earth Space Science  K-12 Life Science  K-12 Physical Science 

13. New Hampshire NECAP Information More NECAP Resources on the NH Science Page: www.ed.state.nh.us Programs and Services  S  Science in NH Schools NH NECAP Inquiry Task Information Planning Guide for Investigations  Planning Guide for Non-Investigations  Sample Investigation Inquiry Task at Grade 4  Sample Non-Investigation Inquiry Task at Grade 8  Sample Non-Investigation Inquiry Task at Grade 11  Released Inquiry Performance Tasks    NH NECAP Science Information NH NECAP Science Assessment Information(includes all assessment targets) Number of Targets by Domain and Grade Span

14. Content Framework for NECAP Science Assessment

15. New Hampshire NECAP Information Eligible NECAP Targets for the Inquiry Task at each grade tested can be found in the Science Process Skills (SPS) GSE in the last row in SPS1 labeled:NECAP Science Assessment Targets for Inquiry (INQ) May be subject of performance component Resources and Information about the Science Frameworks and NH Information about the NECAP Science Assessment can be found at www.ed.state.nh.us Programs and Services  S  Science in NH Schools Science Reference Sheets can be found at the link belowwww.ed.state.nh.us Programs and Services  N  NECAP

16. Item Types

17. Grade 4 Science Pilot Test Design: Session 1: 50 Minutes* Session 2: 95 Minutes** 8 short-answer questions 29 Multiple Choice (1 pt each) Making Your Predictions 2 Constructed Response (4 pts each) Setting Up and Conducting Your Investigation Organizing and Presenting Your Data *For Session 1, students are allowed an additional 45 minutes without an accommodation. Analyzing and Using Your Results A New Investigation **For Session 2, students should complete the Inquiry Task and all questions within 95 minutes.

18. Grade 8 Science Pilot Test Design: Session 1: 50 Minutes* Session 2: 95 Minutes** 8 short-answer questions 29 Multiple Choice (1 pt each) Making Your Predictions 2 Constructed Response (4 pts each) Setting Up and Conducting the Investigation and Collecting Data *For Session 1, students are allowed an additional 45 minutes without an accommodation. Organizing and Presenting Your Data Analyzing and Using Your Results **For Session 2, students should complete the Inquiry Task and all questions within 95 minutes.

19. Grade 11 Science Pilot Test Design: Session 1: 50 Minutes* Session 2: 80 Minutes** 29 Multiple Choice (1 pt each) 8 short-answer questions Prediction 2 Constructed Response (4 pts each) Analyzing and Using Data Organizing and Presenting Data *For Session 1, students are allowed an additional 45 minutes without an accommodation. Using Evidence and Applying What You Learned **For Session 2, students should complete the Inquiry Task and all questions within 80 minutes.

20. Inquiry Task Design: Pilot Test

21. Inquiry Task Design: Pilot Test

22. The New England Common Assessment Program (NECAP) Science Assessment Changes of Note: • For the pilot ONLY, session 1 will be 1 domain per student. Every school will have all domains present. • Student Test Booklet and Student Answer Booklet are separate documents for Grades 4, 8, and 11. • Districts/schools may decide if students can use a calculator on the assessment (not recommended at grade 4.) • A science reference sheet will be provided for each student in grades 8 and 11. (There are different sheets at grade 8 and 11.) The reference sheets are available now on the NH Science web page.

23. Setting up the Inquiry Task Questions

24. School Test Coordinator’s Responsibilities (page 2) Primary responsibilities: • serve as the school’s contact person with Measured Progress • coordinate all test-related activities • prepare test administrators to administer NECAP according to directions in the Test Administrator Manual • oversee the inventory, distribution, collection, and return of ALL test materials • ensure test security and compliance with test administration procedures

25. Test Security (page 3) Test Security relies on the professional integrity of everyone in our schools across all three states. No student should be advantaged or disadvantaged based on how or where the test is administered. All test items and responses to those items in the NECAP are secure and may not be copied or duplicated in any way or kept by the school after testing is completed. Using secure test material to prepare students in any way for this test administration is a violation of test security and testing procedure.

26. Breaches in Test Security (page 3) Any concern about breaches in test security must be reported immediately to the test coordinator and/or principal. The test coordinator/principal is then responsible for reporting breaches to the district superintendent and the state department of education.

27. Getting Ready • Select each school’s Test Coordinator • Communicate test plan to staff • Ensure test security is in place • Schedule testing • Plan logistics around testing—especially for the Inquiry Task

28. Preparation for Test Administration BEFORE TESTING (page 4) Manuals • Read the Principal/Test Coordinator and Test Administrator Manuals Student Participation and Accommodations • The Accommodations and Procedures: Administrators Training Guidecovers these topics: • Who should be tested • Determining how students will participate using accommodations • Documenting and bubbling in accommodation codes

29. Who should be testedfor the pilot? (page 4) • As many students as possible, including: • Students with disabilities • English language learners • Students attending career and technical centers • EXCEPTIONS for the pilot test ONLY: • Students who would normally participate in alternate assessment • ELL students enrolled in U.S. schools less than one year • Students absent for entire testing window • Students experiencing extraordinary personal circumstances

30. Classroom Environment Preparing for the Inquiry Task ~ Grades 4 and 8 Only • Check to ensure there are enough materials for the Inquiry Task. • Materials are packed by “type”, not by kit. • Ensure that students have enough room to place materials on the 11” x 17” Placemat. • Identify plan for setting up materials for the Inquiry Task. • Identify process for grouping students (see Appendix 6 of the Principal/Test Coordinator Manual).

31. Appendix 6:GuidelinesforGrouping Students in Session 2 ~ Grades 4 & 8 only

32. Accommodations for the Pilot • Who is eligible for testing accommodations? ALL students • Accommodations do not change what we expect students to know and be able to do. • Test accommodations are based on individual student needs and classroom assessment practice; they are not for the use of an entire classroom or category of students. • They should not give students unfair advantages; rather they are meant to remove barriers that may exist due to a student’s learning style or disability.

33. Appendix 5:Table of Standard Test Accommodations (Page A-6)

34. Accommodations for the Pilot • Accommodations, Guidelines, and Procedures: Administrator Training Guide – Still available on state DOE website under NECAP, but not yet updated for Science. Everything listed there is still available. • For the Science Pilot, Use the Table of Standard Test Accommodations found in Appendix 5 of the Test Coordinator and the Test Administrator Manuals. Only these manuals have the most recent updates. • School teams may use, without state approval, only standard accommodations listed in categories A, B, C, or D. Please note: Categories E and F work differently, as follows:

35. Accommodations for the Pilot Use of Category E “Other” Accommodations - Contact NHDoE, Gaye Fedorchak, in advance of testing to discuss any other (non-listed) accommodations you want to use during the pilot. • Accommodation(s) must be consistent with those used in student’s regular classroom instruction. • If the DOE finds the Category E-Other accommodation to be comparable to a standard accommodation, we will note this and consider for future updates to Accommodations Manual. • DOE is seeking & collecting teacher ideas for the Inquiry Task • During full test implementation (May 2008), student work done using category A, B, C, D, or state approved E accommodations will be fully credited & scored.

36. Accommodations for the Pilot Use of Category F Modifications - • If the state determines that your request for a (non-listed) E-Other Accommodation will change what the test measures, then the state will respond in writing that use of this procedure will produce a test “modification” and must therefore be documented as an F-Modification. • After the pilot, during full test administration, use of an F-Modification will result in no credit given for student work during test sessions in which this F-Modification was used. • When full assessment starts, any E –Other Accommodation not registered as “approved” by your state DOE will be treated as an F- Modification.

37. Accommodations for Pilot • After Testing, Document all accommodations and modifications actually used on page 2 of the Student Answer Booklet. (If not used, don’t bubble.) • Accommodation Updates for the Science Pilot: • C-4 ……. Now includes Science • C-12 ….. Now includes Science • C-13 ….. Does not appear in Test Manuals but is still in effect • for NECAP and will return in future manuals. • An abacus is not likely to be needed for the Science • Pilot. • D-5 ……. Now includes Science • D-6 ……. Now includes Science • D-7 ……. Reserved for Future Standard Accommodation (after • pilot data is gathered)

38. Accommodations - Thinking long term • Support teachers through the accommodations decision- • making process. • Include all of a student’s classroom teachers, parents, and, • whenever possible, the student in the decision-making • process. • Consult with parents regarding use of accommodations • through phone or similar kinds of contacts. A face-to-face • meeting is not required. • Standardize the accommodation administration process and • plan the resources necessary for large-scale implementation. • Ensure that the students’ records include the decisions made • to inform both current and future educational planning.

39. Scheduling Test Sessions (page 5) • Session 1 of the NECAP Science pilot test in grades 4, 8, and 11 is designed to be completed in approximately 50 minutes. • Students are allowed an additional 45 minutes for Session 1 without an accommodation. Plan accommodations for those students who typically take more than 50% additional time for regular classroom assessment. Only those students with an extended time accommodation may be permitted more than 95 minutes to complete Session 1. • Session 2 of the NECAP Science pilot test in grades 4 & 8 is designed to be completed in approximately 95 minutes. Session 2 in grade 11 is designed to be completed in approximately 80 minutes. • The student questionnaire for grades 4, 8, and 11 is designed to be completed in 20 minutes.

40. Scheduling Test Sessions (page 5) • All testing, including accommodated sessions, must occur within the testing window. • Test sessions must be scheduled and given in the order presented in the Student Test Booklet. • All classrooms of students in a school should take the same test session simultaneously.

41. Student ID Labels (page 7) • Student ID Labels • Labels created for students based on beginning of school year 2006-07 enrollment files • 2 identical labels printed for each student (one for Student Answer Booklet, one for Student Test Booklet) • Student labels are sorted by group field prior to printing (if requested)

42. Student ID Labels (page 7) Students enrolled in your school WITH Student ID Labels • 3 fields MUST be correct in order to use label: student name, state-assigned Student ID number, and school name • If any of the 3 fields are incorrect or missing, DO NOT USE the label. • Call your state DOE to report incorrect information. • Follow procedure for students without Student ID Labels.

43. Student ID Labels (page 7) Student ID Labels for students NOT in your school • Labels are NOT transferable between schools. • Throw away any labels provided for students not enrolled in your school. • DO NOT forward these labels on to other schools. • DO NOT affix these labels to Student Answer Booklets.

44. Student ID Labels (page 7) Students WITHOUT ID labels • Complete the student information on pages 1 and 2 of the Student Answer Booklet.

45. Preparing Student Test Booklets and Answer Booklets for Testing (page 7) • Booklets will be shrink-wrapped in packs of 15, 10, 5, and singles. • Count the booklets to verify that the quantity received matches the quantity sent. Call Measured Progress if your count does not match the quantity indicated on the Material Summary form sent by Measured Progress. • Do not re-sequence test booklets or answer documents. • Student Answer Booklets come inserted in the Student Test Booklet, paired by form.

46. Preparing Student Test and Answer Booklets for Testing (page 7) • DO NOT separate the Student Answer Booklets from the Student Test Booklets. • If the booklets do become separated, you will need to match the form number on the front cover of the Student Test Booklet with the bracketed portion of the number printed on the bottom right corner of the Student Answer Booklet. • The unique serial numbers on Student Test Booklets and Student Answer Booklets are not designed to match.

47. Preparing Student Test Booklets and Answer Booklets for Testing (page 7) For students WITH Student ID labels • For students enrolled with a label, affix the label to the front cover of the Student Answer Booklet. • Affix second label on the front cover of the Student Test Booklet For students WITHOUT Student ID labels • For students enrolled without a label, fill in all required information. • Write student name and school name on cover of the Student Test Booklet

50. New Hampshire