WELCOME CAASPP Test Administrator Workshop March, 2014
Purpose of the Smarter Balanced Field Test • Evaluate testing software • Ensure quality of test questions • Evaluate the effectiveness of the test administration and training materials • Establish scoring and reporting levels • “Dress rehearsal” for operational assessments in 2015 • “Stress test” LEA technology • Familiarize educators, administrators, and students with online testing • ONLY FAILURE IS SECURITY FAILURE
Field Test Participation:Who Will Take the Field Test? • Grades 3–6: All students • The only students exempt from participating in the Field Test are: • Students participating in the California Alternate Performance Assessment (CAPA) • For the English language arts/literacy (ELA) test only, English learners (ELs) who have been attending school in the United States for less than 12 months • Students who have SIGNED OPT OUT LETTERS ON FILE IN SCHOOL (TO BE UPDATED YEARLY) under Ed Code Section 60615
Test Administrator Responsibilities • READ and sign security affidavit • Ensure all policies and procedures are followed including… TEST SECURITY • Complete Smarter Balanced test administration training (TODAY) • Review all policies and administration documents prior to testing • Verify student information in the TIDE system • Administer Smarter Balanced Assessment • Report all potential test security incidents to SC IMMEDIATELY
Additional Resources Smarter Balanced Manuals & User Guides California Online Field Test Administration Manual TIDE User Guide for California Users Technical Specifications Manual for Online Testing http://sbac.portal.airast.org/ca/field-test-ca/resources/ Smarter Balanced Training Modules (Video) http://sbac.portal.airast.org/ca/field-test-ca/resources/
Site Coordinators’ Responsibilities • #1 Responsibility—Security • No unauthorized electronic devices used in classroom during testing (NO CELL PHONES) • For testing purposes, any electronic device that is not specifically designated as an accommodation or modification in the student’s IEP or Section 504 plan is unauthorized.
Section 1 Security Affidavits Breaches Irregularities Improprieties
Security ONGOING FOCUS • No unauthorized electronic devices are being used. • 400 instances of test item posting to social media sites last year (after security emphasis began)
Securing Student Information • SSIDs and Student Info are Confidential • Must be securely destroyed • May not be communicated over email • Mishandling is a violation of State and Federal Law including the Family Educational Rights and Privacy Act • School Sites May: • Collect and secure log-on cards to be handed out each day to students
Site Coordinators Train Examiners: (A few obvious reminders) • Test Administrators CANNOT: • Review test questions before, during, or after testing. • Check students’ answers including (but not limited to): • Advise students of wrong answer or to check an answer; or • Halt a student from continuing their test until they demonstrate that they have the right answers.
What is a Testing Impropriety? Formerly Called ‘Incidents’
What is a Testing Irregularity? Irregularities affect the results of a testing administration
What is a Testing Breach? Breaches affect the security of the test
Section 2 Testing Timeline and Schedules
Examples of Field Test Participation in California • Example: Elementary School X • Grade 3 was assigned a single content area (ELA), which includes an ELA performance task (PT). • Grade 4 was assigned both ELA and math, with a mathematics PT. • Grade 5 was assigned both ELA and math, with an ELA PT.
Field Test Format • The Field Test is computer-based, notcomputer adaptive. • Need to try out the test questions during the Field Test before tests can be made adaptive for the first operational administration in 2015. • Two components: • Performance task (PT) • A set of complex questions that is centered on a common theme or problem; requires classroom activity • Non–performance task (non-PT) • E.g., Selected Response, Drag and Drop, Matching Tables
Testing Times (p. 35 and 36) 95% of students
Section 3 Universal Tools, Designated Supports and Accommodations
Universal Tools • Available to all students (no documentation is needed) • Can be digitally delivered or in real world • Nothing must be turned on… it is automatically there • Can be turned on or off by teacher on TIDE system if it is distracting • Already there for everyone… nothing is needed to set up
Designated Supports • Available to students identified as English learners, struggling readers, students with attention deficits, or any student • Determined by educators who know the student’s instructional and assessment needs • Can be turned on or off by teacher on TIDE system • Communicated to parents • Awaiting guidelines • “Consistent with state designated practices”
Accommodations • Available to students with IEPs or 504 plans • Determined by IEP teams or educators responsible for 504 plans • Can be turned on or off by TIDE system
Invalidation of Scores • Students who use these accessibility supports will have invalidated scores on both Smarter Balanced and / or CST/CMA. • English Dictionary for Listening, Math, Science • Thesaurus for Reading, Listening, Math, Science • Translated Test directions for Reading, Writing, Listening • Bilingual dictionary for Reading, Listening, Math, Science • Translations (glossary) for Reading, Writing, Listening
Invalidation of Scores (cont’d) • Students who use these accessibility supports will have invalidated scores on both Smarter Balanced and / or CST/CMA. • Read aloud for Reading Passages in grades 3 – 5 • ASL for Reading passages in grades 3 – 5 • Calculator for Non-specified Math or Science items • Math tools(ruler, protractor) for Non-specified Math • Multiplication Table for Math in grade 3 All Requests Must Be Submitted 10 Days Prior to CDE
Who Decides Who Gets What? • Students with 504s and IEPs • IEP Team • Non-504 or IEP Students • Recommended by an school site individual who knows the child’s educational abilities. • Should only receive a designated support if it is already regularly done in class. • School Team reviews the recommendation and will approve or deny.
Who Codes the Support in TIDE? • Students with 504s and IEPs • Test Site Coordinator (based on information attained from Case Managers) • Non-504 or IEP Students • Test Site Coordinator and Principal are responsible for ensuring that all students are adequately coded in TIDE
Section 4 Test Site Coordinator, Test Administrator, Proctor Responsibilities
Test Site Coordinator Responsibilities (before, during, after testing)
BEFORE TESTING Staff Training Reminders
BEFORE TESTING Preparing Test Environment
BEFORE TESTING Directions for Administration (DFA)
BEFORE TESTING Test Administrator Checklist • Pages 84 – 89 of the Online Field Test Administration Manual
BEFORE TESTING Proctors • Proctors may cover multiple rooms.
Secure Browser • Specifically designed by Smarter Balanced to provide secure access to the Field Test. • Prevents students from accessing other hardware and software functions. • Volume must be UP prior to start of testing • A secure browser must be installed on all • student computers/devices. • Updated and reinstalled annually • http://sterling3a/cmapplicationcatalog • Any Site Tech can install…
Section 6 TIDE
BEFORE TESTING Access to TIDE
Student Sign In • Test Session: CARR1234 (generated by computer when TA signs in to open a session) • Confirmation Code: Robert (first name in CALSPADS) • CA – 1020304050 (SSID) SECURE!!
Test Information Distribution Engine (TIDE) TIDE is a password-protected Web site that provides administrators with tools to manage users and students participating in the Smarter Balanced Field Test. • Database of student information, including initial test settings and accommodations
TIDE: First-Time Users • When a user is added to TIDE, the user will receive an automated email from Smarter-CA-DoNotReply@airast.org that contains the following: • User role • Temporary password that must be changed upon initial login • If user has not received the e-mail with temporary password, he or she should contact the school coordinator.
Accessing TIDE • Select the Online TIDE System for California Users card. • Use password sent in email. • When logging into TIDE for the first time, users will be prompted to change their password.
Navigating TIDE • The TIDE interface uses tabs as the principal means of navigating between tasks. Some tasks in the TIDE interface contain multiple sub-tasks. • TIDE shows only the features that are available to the user based on his or her role.
TIDE: Manage Users Tab • The Manage Users tab may be used to: • Upload users (group of users) • Add new user (individual user) • Search for existing user records • Export a list of existing user records • View and/or edit existing user records • Delete an existing user record
TIDE: Export a List of Users • For reference purposes, a user may choose to export a list of users in his or her school or district. • Users may conduct a search for other users. • To export the resulting list of users, select [Export] and select the desired format (Excel or CSV). • You may select a subgroup of users for export by selecting the check box next to each record you want to include in the export.