Sandy GarrettState Superintendent of Public Instruction Oklahoma State Department of Education Oklahoma School Testing Program (OSTP) General Assessment Information Test Preparation Inservice 2009 – 2010
Agenda • Testing Overview • General Information • Accommodations • Invalidations and Equivalent Forms • Test Security and Related Information • Instructions and Information • Oklahoma Core Curriculum Tests (OCCT) Grades 3 – 8 • Oklahoma Modified Alternate Assessment Program (OMAAP) • Oklahoma Core Curriculum Tests (OCCT) End-of-Instruction (EOI) • Resource and Contact Information
Testing Overview • The purpose of the Oklahoma School Testing Program (OSTP) is to assess students’ mastery of the Priority Academic Student Skills (PASS). • The Oklahoma Core Curriculum Tests (OCCT) for Reading and Mathematics are accountability tests required by the 2001 federal legislation No Child Left Behind (NCLB).
Testing Overview WhoParticipates? • Every student enrolled in a tested grade level in an Oklahoma public school must participate in testing. • All students will be administered either: • An OCCT general assessment with or without accommodations; or • An alternate assessment. • Oklahoma Modified Alternate Assessment Program (OMAAP) • With or without accommodations • Oklahoma Alternate Assessment Program (OAAP or Portfolio)
Online Testing • User names and passwords are supplied by the testing vendors for accessing the online systems. • Regional in-service trainings for online tests for Grade 7 Geography and Grade 8 Math and Reading will be conducted in March. • Regional in-service trainings and WebEx trainings for online EOI tests will be conducted for Winter/Trimester and Spring administrations. (Please refer to the Test Preparation Manual (TPM) pages ii and iii for dates.)
Demographic Information Precode Is Required for All OCCT Assessments • Precoding provides student demographic data to vendors electronically before the time of testing. • Demographic information for Grades 3 – 8 tests will be submitted by the Wave. • Labels are produced to place on scannable answer documents. Benefits: • Reduces administrative time • Increases accuracy • Merges student records for English II/III Writing and Multiple-Choice
Demographic Information Student Information • Overrides of student precode information are allowed on the demographic pages EXCEPT for the following: • Student name, • Student ID, • Grade, • Date of birth, and • Gender. Grades 3 – 8 (TPM pages 40 – 41) EOI (TPM page 25)
Demographic Information • Demographic pages must be completed and labels affixed for all students enrolled in the grades tested, regardless of whether or not they actually take the test (e.g., Absent, IEP Alt., Other Placement). • Incorrect or incomplete information will result in inaccurate student data and may have a negative impact on the final reports. • This includes assessment reports as well as accountability reports.
Demographic Information • Districts will be able to make online corrections during the Online Correction/Verification window. • Online training for these systems will be provided. • Preliminary reports will be in districts for the correction windows. • Districts will be required to verify this information. • The SDE will not be making corrections that should have been made during the correction windows.
Testing Accommodations • Accommodations for IEP and Section 504 students must be: • Specified in an IEP or Section 504 Plan; • Selected from the accommodations specified • in the appendices of the Test Preparation Manuals; and • Marked on the demographic page by subject for all assessments. • Setting • Presentation • Timing/Scheduling • Response
Testing Accommodations • ELL accommodations must be: • Selected from the accommodations specified in the appendices of each Test Preparation Manual; and • Marked on the demographic page by subject for all assessments. • Translator • Transcribe • Clarification • Grouping/Multiple Sessions • Word-to-Word Dictionary
Testing Accommodations • ELL 1st year proficient or ELL 2nd year proficient indicates that an ELL student has attained proficiency and has exited the program within the last one or two years. • Students must be marked as either ELL 1st year proficient or ELL 2nd year proficient. • Donotmark both ELL and ELL 1st year proficient or ELL 2nd year proficient. • The ELL enrollment date is the date they first entered any United States school.
Testing Accommodations • Large-print and Braille versions of each test are available for visually impaired students. • Large-print and Braille responses must be transcribed to a scannable standard test book (Grade 3 and all Modified) or scannable standard answer document (Grades 4 – EOI). • The Test Preparation Manuals include transcribing information and procedures.
Braille • When a Braille test is ordered, you will receive a packet with the following: • 1 Braille test • 1 answer document • 1 regular test booklet • 1 Test Administration Manual • 1 set of instructions • When a student’s Braille response is transcribed into a scannable answer document, the IEP Braille bubble must be completed.
Testing Accommodations • Audio features are available for a read aloud accommodation on the following tests. • Grade 7 Geography • Grade 8 Math • ACE Algebra I • ACE Algebra II • ACE Geometry • ACE Biology I • ACE U.S. History
Testing Accommodations • The Grades 3 – 8 Reading tests and the English II and English III Multiple-Choice tests cannot be read aloud at any time as an accommodation; therefore, there will be no audio available for these assessments.
Calculator Use EOI (OCCT and OMAAP) • Algebra I , Geometry, and Biology I – Scientific Calculator • Algebra II – Graphing Calculator Grades 3 – 8 (OCCT and OMAAP) • May only be used as an accommodation for the Math tests. • May only use a basic four function nonscientific calculator.
SDE Approvals Required • State Department of Education (SDE) approval is required for the following: • Other Placement; • Emergency Exempt; • ELL 1st Year in U.S. Exempt (Writing, Reading, and English II & III assessments only); and • Invalidated. • Requests of approval are available on the School District Reporting Site (SDRS). • Complete the Testing Status Application Form. • Letters on a school letterhead must be faxed to the SDE for emergency exemptions and invalidations.
Test Invalidations • Reasons for possible test invalidations include, but are not limited to, the following: • (1) cheating; • (2) security violation; • (3) improper test administration; or • (4) testing outside the testing window. • If the SDE approves the invalidation, the student must be considered as a nonparticipant unless an Equivalent Test is administered.
Equivalent Tests • In situations where a student becomes ill and cannot finish a test, the District Test Coordinator (DTC) must contact the SDE for an invalidation and instructions on obtaining an Equivalent Test. • Any Equivalent Test must be administered to the student within the remaining testing window.
Equivalent Tests Equivalent Tests are available for: • Mathematics and Reading for Grades 3 – 8 (OCCT and OMAAP); • Grade 7 Geography (for online technical problems only); • All seven EOI subjects (OCCT); and • English II, Algebra I, Biology I, and U.S. History (OMAAP). Note: All completed answer documents for Equivalent Tests must be returned with the scorable answer documents.
Guidelines for Students Who Receive Instruction Away from Sites of Official Enrollment Students Testing at Alternative Sites • This includes: • Special education consortiums; • Alternate education cooperatives and interlocals; • Hospital placement; • Homebound placement; and • Students enrolled at Oklahoma School for the Blind or the Oklahoma School for the Deaf.
Guidelines for Students Who ReceiveInstruction Away from Sites of Official Enrollment Students Testing at Alternative Sites • All paper/pencil test materials will be ordered by and sent to the district where the students are officially enrolled. • Students may be tested at their sites of instruction following the procedures outlined in the Test Preparation Manuals. • The official site of residence district remains accountable for the test scores.
Guidelines for Students Who ReceiveInstruction Away from Sites of Official Enrollment Flowchart for OCCT EOI Online Assessments • Site of residence: • precodes the • student; • places student in a • testing session with • a start date; • prints a test ticket; • and • delivers the test • ticket to the site of • instruction. Site of instruction tests the student. Do not upload into a session. Site of residence submits the student’s test after the student shows a “Stopped” status in the testing session.
Guidelines for Students Who ReceiveInstruction Away from Sites of Official Enrollment Students Testing at Alternative Sites • Score reports will be sent to the districts where the students are officially enrolled. • The Test Administrator and the Test Monitor (at the site of instruction) sign a Test Security Form. All test books, answer documents, test tickets, and security forms are returned to the site of residence.
Virtual Students • Schools must account for all students. This includes virtual students. • In the precode file or on the demographic page, the student should be marked as distance learner.
Test Security Who should be trained on Test Security and administration procedures? • District Test Coordinators (DTC) • Building Test Coordinators (BTC) • Test Administrators (TA) • Test Monitors
Test Security • Test materials should be kept secure at all times and should not be left in open or unattended areas. • Test books are not to be opened prior to or after any test session. Only the students tested are allowed to view the contents of a test booklet and only at the time of testing.
Test Security Nondisclosure Agreement Forms • Nondisclosure Agreement Forms must be signed and • dated by each TA who reads test items to students as an • accommodation and by the Test Monitor. The • completed form must be returned to the BTC. • Note: The Reading and English II and III tests may not be read to any student as an accommodation. • This form is included in the BTC kit. A copy may also be found in the Test Administration Manual and/or online.
Test Security • All secure test materials (test books, answer documents, and accommodated materials) must be returned to the appropriate testing vendor after the completion of testing. • Keep a copy of all security forms for your records. Originals must be returned to the appropriate testing vendor. • Ensure that all student information is handled according to FERPA guidelines. Contact USDE Family Policy Compliance Office at (202) 260-3887 for more information. • Example: A party can be given to celebrate the end of testing, but a party cannot be given to reward all students who pass the test. That would also identify who did not pass the test.
Test Security • District and Building Security Forms are pre-slugged • with your county, district, and site code. These are • scannable forms that cannot be copied. • The OCCT 3 – 8 testing vendor (DRC) will provide the Test Security Forms for the OCCT 3 – 8 general assessments and the OMAAP 3 – 8 assessments. Mark the appropriate box or boxes on this form to indicate compliance. • The OCCT EOI testing vendor (Pearson) will provide the Test Security Forms for the OCCT EOI general assessments and the OMAAP EOI assessments. Mark the appropriate box or boxes on this form to indicate compliance.
Test Security • District Level Test Security Forms • Scannable—Originals must be completed and returned. • Building Level Test Security Forms • Scannable—Originals must be completed and returned. • Test Administrator and Test Monitor Security Forms • Not scannable—May be copied. Package and send Test Security Forms for: • all 3 – 8 OCCT and 3 – 8 OMAAP tests to DRC and • all EOI OCCT and EOI OMAAP tests to Pearson. Riverside will not be collecting any Test Security Forms.
Test Security Classroom Security Checklists Classroom Security Checklists must be completed, signed, and dated by the TA and the BTC. It is criticalthat each security barcode be matched to a student’s name. The checklists are included in the DTC kit. A copy may also be found in the Test Administration Manual and/or online. Additional important information regarding test security and validity is included throughout and in the appendices of each Test Preparation Manual.
Test Security • Late materials may result in: • Cost, • Invalidations, and/or • Deficiency on the district accreditation report.
District Test Coordinator (DTC) Instructions and Information
DTC Instructions and Information General Responsibilities: • Serve as the SDE’s contact for all testing activities. Note: E-mail is often the quickest and most efficient way for the SDE or testing vendors to contact DTCs, so please access your account regularly. • Request permission from the SDE for citing specific demographic designations, invalidating assessments, and/or ordering Equivalent Test. • Ensure that all personnel assigned to testing are adequately trained in proper test administration and test security. • Sign-in sheets for training sessions should be kept on file by the DTC or BTC.
DTC Instructions and Information • Confirm all boxes are received for each building and distribute materials accordingly. Inventory materials immediately upon receipt. Contact the appropriate testing vendor with any discrepancies found during the inventory of materials. • Fax completed Delivery Verification Forms upon inventory of secure materials for Grades 3 – 8 OCCT assessments and OMAAP assessments for all grades/subjects.
DTC Instructions and Information • There will be two shipments per administration: • Guides for Parents, Students, and Teachers (one per student) • Shipment arrives in district 6 weeks prior to testing. • DTC distributes to BTC who distributes to each TA for classroom use. • Secure Test Materials and Test Coordinator Kits • Shipment arrives in district 2-3 weeks prior to testing. • DTC distributes BTC Kits and Secure test materials to school sites in preparation for testing. • Secure testing materials may be delivered to schools one week before testing begins but may not be passed out to teachers until the day of testing.
DTC Instructions and Information District and Building Site Overages • Districts and buildings will receive an overage of standard testing materials. • BTCs should contact the DTCs for additional materials once the overage they have received is exhausted.
DTC Instructions and Information Additional Materials Requests: • Additional requests should only be made after the district overage has been exhausted. • Requests must be submitted by the DTC, sent only via fax or E-mail (as applicable) to the appropriate testing vendor. Phone orders will not be accepted. • Additional orders requested less than one week before the test begins may not be received in time for testing.
DTC Instructions and Information Collection and Return: • Confirm that each scorable answer document includes ALL necessary student demographic data. • Verify all non-scorable secure materials as they are received from each BTC. • Confirm that scorable materials are returned in separate boxes from non-scorable secure materials. IMPORTANT: If an answer document for a Grades 3 – 8 OCCT general assessment has a DO NOT PROCESS Label (blue)affixed to the demographic page, return with non-scorable secure materials.
DTC Instructions and Information Collection and Return: • Follow specific packing procedures for each administration. Diagrams or posters in the DTC Kits and information in the Test Preparation Manuals illustrate packing and shipping details for each testing vendor. It is imperative that instructions for each vendor are followed meticulously. • If any materials are discovered after your shipment has been picked up, contact the appropriate testing vendor IMMEDIATELY.
DTC Instructions and Information Collection and Return: • Return pick-up arrangements MUST be scheduled by the DTC. Specific carriers must be used for each of the three testing vendors. Instructions for return shipments are outlined in the Test Preparation Manuals. • For Grades 3 – 8 OCCT general assessments, you MUST use the same shipper for both the Writing and Multiple-Choice administrations. • For EOI OCCT general assessments, a set pick-up date has been scheduled for: • Winter Writing - December 14, 2009 Multiple Choice January 12, 2010 • Trimester Writing - January 29, 2010; and • Spring Writing - April 26, 2010.
Building Test Coordinator (BTC) Instructions and Information
BTC Instructions and Information General Responsibilities: • Direct the entire testing procedure at the specified building site and serve as the contact for the DTC. • Inventory all test materials upon receipt from the DTC and manage the BTC Kit contents. • Identify students who need special accommodations and/or alternate assessments. • Complete Class Identification/Class Header Sheets in order to generate classroom or teacher level reports.
BTC Instructions and Information General Responsibilities: • Train the TAs and Test Monitors. • Check testing materials out to TAs the day of testing using the Security Checklist. • Verify the presence of a Test Monitor in every testing session before testing begins. • It is a violation to administer any assessment without a Test Monitor present. • Collect all test materials from the TAs upon completion of testing each day.
BTC Instructions and Information Collecting and Returning Materials: • Upon completion of testing, collect all signed Test Security Forms, Classroom Security Checklists, and Nondisclosure Agreement Forms. (Keep copies for your records and give the originals to your DTC.) • All materials must be accounted for and returned to the DTC. Follow the step-by-step instructions in the Test Preparation Manuals for checking and assembling the test materials for return to the DTC. • Guides for Parents, Students, and Teachers and the Test Administration Manuals do not need to be returned to the vendor.