ASSESSMENTS & ACCOUNTABILITY

ASSESSMENTS & ACCOUNTABILITY Suspense Resolution and Reports Assessments & Accountability v 1.0

Mute phones while listening (*6 to mute and un-mute) Do not place your phone on HOLD Silence cell phones Hold questions until Q&A periods Submit all questions via the Chat function GROUND RULES 2 Assessments & Accountability v 1.0

Assessment and Accountability (A/A) Assessments & Accountability v 1.0

A/A Expectations • Assessment and Accountability functionality in CALPADS is being implemented to support: • Building a complete individual student assessment history for STAR, CAHSEE, and CELDT • Improving the accuracy and consistency of data used to evaluate performance of individual students and educational entities Assessments & Accountability v 1.0

A/A Expectations • Achieving these objectives will require several iterations of CALPADS functionality • Current phase of functionality is focused on identifying issues for both LEAs and CDE related to the loading of data • Future functionality will address these issues as well as enhance the accessibility and usability of the data for LEAs and CDE Assessments & Accountability v 1.0

A/A Expectations • The initial CALPADS A/A functionality requires no changes in the way LEAs currently work with assessment vendors or with CDE • Student Demographic changes will continue to be made through the testing vendor • Testing Vendors will provide test results & reports as usual • Pre-ID, where applicable, will continue as usual • Testing processes will continue as directed by assessment program offices • AYP/API results will continue to use the student data you supply to test vendors Assessments & Accountability v 1.0

A/A Expectations • LEAs will: • Match student records for your LEA to the correct SSID when CALPADS cannot make the match automatically • Verify the reports • Provide feedback to improve functionality Assessments & Accountability v 1.0

A/A Expectations • CDE will: • Match student records to the correct SSID in CALPADS, when a LEA flags a record as “Not Mine” • Negotiate contracts with assessment vendors that ensure the data needed for a student’s complete assessment history in CALPADS is available and timely • Coordinate with each assessment program area to enable CALPADS to… • Provide a consistent approach to managing and reporting assessment data • Report assessment results that reflect the testing procedures communicated to LEAs Assessments & Accountability v 1.0

A/A Expectations • CDE will: • Evaluate the outcome to determine the impact on LEAs and Accountability reports of using CALPADS data instead of vendor test data • Work with LEAs to provide functionality focused on data accessibility and usability • Communicate When and How: • Results data left in suspense will impact Accountability reporting • Current vendor relationships will be impacted Assessments & Accountability v 1.0

A/A Expectations Logistics • A schedule for data loads is included in the report sections for each Program • Assessment and Accountability Coordinators receive an email when vendor data is loaded • Report content is frozen when CDE performs the last snapshot for a Program Administration after all data received from the assessment vendor has been loaded Assessments & Accountability v 1.0

Suspense Management Assessments & Accountability v 1.0

Suspense Management CALPADS Assessment Results: • Suspense - (i.e. unsuccessful matches) • Matched – (i.e. successful matches) Assessments & Accountability v 1.0

Suspense Management Reason for Suspense Record: • Miss-match in student demographic data (gender, date of birth year) between the assessment results file and CALPADS • Missing CALPADS enrollment at time of testing • Missing SSID Administration Date As soon as one of these conditions is not met, CALPADS places the record in suspense. Assessments & Accountability v 1.0

Suspense Management Importance of Suspense Resolution: • A record in suspense will not be matched to a CALPADS SSID, which leaves the CALPADS assessment longitudinal record incomplete for this SSID • As students enroll at other districts their assessment data will be missing if not matched • Records in suspense do not appear in reports; therefore, your CALPADS assessment and AYP/API reports will not be complete Assessments & Accountability v 1.0

Suspense Management CALPADS Functionality • Suspense data can be resolved both Online & in Batch • Both methods are accessed from the Assessment menu Assessments & Accountability v 1.0

MANAGING SUSPENSE DATA - ONLINE Assessments & Accountability v 1.0

Manage Suspense Data - Online LEA SUSPENSE Workflow • Review Suspense Records • Determine best resolution • Apply resolution • Wait for refresh and verify suspense resolved Assessments & Accountability v 1.0

Manage Suspense Data - Online Suspense Resolution Workflow 18 Assessments & Accountability v 1.0

Manage Suspense Data - Online LEA SUSPENSE REASONS • Date of Birth Mismatch: If Student Date of Birth Year for SSID in results record <> Student Date of Birth Year in ODSR SINF data that was valid at the time of testing • Gender Mismatch: If Student Gender Code for SSID in results record <> Student Gender Code in ODSR SINF data that was valid at the time of testing • SSID Mismatch: If SSID in results record does not exist in ODSR • Admin Date Empty: If the Administration Date in the results record is blank • LEA Mismatch: If enrollment in LEA at the time of testing could not be validated Assessments & Accountability v 1.0

Manage Suspense Data - Online LEA SUSPENSE RESOLUTIONS • the LEA correcting CALPADS data • the vendor correcting results data • the LEA and/or CDE manually assigning the suspense record to the correct SSID Assessments & Accountability v 1.0

Manage Suspense Data - Online Resolution STEP 1: Review LEA Suspense Filter : Program, Administration, Academic Year, and Matched Result (LEA Suspense) Note: Filter Options are subject to user’s access rights LEA Matched LEA Suspense CDE Suspense ADMIN Date & Suspense Reason Assessments & Accountability v 1.0

Manage Suspense Data - Online Resolution STEP 2a: Determine Resolution • If the resolution for the Suspense Reason requires … • Data addition/changes in CALPADS, make the additions/changes and either 1) match immediately to the corrected record using STEP 3, since the changes to ODS are available real-time, or 2) wait for the nightly suspense process to recognize that the CALPADS demo has changed and now matches the results record demo, eliminating the suspense automatically • Contacting the vendor to make changes, the suspense process that runs during a load will eliminate the suspense when CDE receives and loads the corrected data from the vendor. • Manual Matching the record with incorrect demographic data to a CALPADS record with the correct demographic data. Assessments & Accountability v 1.0

Manage Suspense Data - Online Resolution STEP 2b: Determine Resolution • If the student record in suspense does not belong to your LEA, select “Not Mine” • The record is placed in CDE’s queue for resolution. CDE can match the record to a student in another LEA. 1 1 2 2 Assessments & Accountability v 1.0

Manage Suspense Data - Online Assessments & Accountability v 1.0

Manage Suspense Data - Online Resolution – SELECT MATCH Select Match initiates the user-defined search for a CALPADS SSID to which the result record belongs Assessments & Accountability v 1.0

Manage Suspense Data - Online Resolution – SELECT MATCH, step 1 Select Match John Doe Assessments & Accountability v 1.0

Manage Suspense Data - Online Resolution – SELECT MATCH, step 2 • Enter SSID and/or demographics, using * wildcard if needed Enter Search Criteria Assessments & Accountability v 1.0

Manage Suspense Data - Online Resolution – SELECT MATCH, step 3 • Review matching results displayed by SSID and/or Demographics, depending on the criteria entered Note the incorrect Birth Year Suggested Correction Record Assessments & Accountability v 1.0

Manage Suspense Data - Online Resolution – SELECT MATCH, step 4 • Make selection and answer “OK” to initiate the match Select the record to which suspense record will be matched Assessments & Accountability v 1.0

Manage Suspense Data - Online Resolution – SELECT MATCH, step 5 • Both the suspense record and the selected match record are displayed • Select Match Record to resolve Select “Match Records” Assessments & Accountability v 1.0

Manage Suspense Data - Online Matched Records The Matched Student List displays the Assessment Results record and the CALPADS record to which it has been matched LEA Matched LEA Suspense CDE Suspense Assessments & Accountability v 1.0

Manage Suspense Data - Online MATCHED STEP 1: Confirm Matches • The source of the match is identified in the field “Match Source”. The source could be Batch, LEA, or State. Assessments & Accountability v 1.0

LEA Matched LEA Suspense CDE Suspense Manage Suspense Data - Online MATCHED STEP 2: Resolve Incorrect Match • Matched records can be …. • unmatched if incorrectly matched (UNMATCH) and re-matching will occur later • unmatched if incorrectly matched and re-matching will occur now (SELECT NEW MATCH) • unmatched and sent to CDE for matching to another LEA (NOT MINE) Assessments & Accountability v 1.0

Understanding Suspense Data LEA SUSPENSE REASONS & RESOLUTIONS Assessments & Accountability v 1.0

Understanding Suspense Data LEA SUSPENSE REASONS & RESOLUTIONS (Cont.) Assessments & Accountability v 1.0

Assessment Reports Assessments & Accountability v 1.0

ASSESSMENT REPORTS ASSESSMENT MENU Two entry points from Assessment Menu Assessments & Accountability v 1.0

ASSESSMENT REPORTS REPORTS • xxxxxxxxx Assessments & Accountability v 1.0

ASSESSMENT REPORTS REPORTS (Cont) • xxxxxxxxx Coming CDE Only 50.1 Assessment Upload – Detail 52.1 Assessment Snapshots - Detail Assessments & Accountability v 1.0

ASSESSMENT REPORTS Operational STATUS REPORTS CDE Only • 50.1 Assessment Upload – Detail • 52.1 Assessment Snapshots - Detail Assessments & Accountability v 1.0

ASSESSMENT REPORTS STATUS REPORTS - SUSPENSE 51.1 Assessment Suspense – Summary Summary of LEA and School Assessment Suspense by Administration Assessments & Accountability v 1.0

3224589451, Grey, Jordan Abdul, Jordan 2274589451, 5288589451, Ferrell, J ASSESSMENT REPORTS STATUS REPORTS - SUSPENSE (Cont) 51.2 Assessment Suspense – Student Detail Detail of LEA and School Assessment Suspense for one or more Programs and/or Administrations Assessments & Accountability v 1.0

ASSESSMENT REPORTS REPORTS AVAILABLE • The following types of Assessment reports are available • Summary LEA results for STAR, CAHSEE and CELDT, including county & state comparisons • Individual student result detail supporting the summary results for STAR, CAHSEE, and CELDT • Currently enrolled students missing CAHSEE • Currently enrolled students needing CELDT • The following types of AYP/API reports will be available • Students included in the AYP/API results • The following types of individual student reports are available • Individual student assessment history Assessments & Accountability v 1.0

ASSESSMENT REPORTS • Assessment reports use CALPADS demographic data with the vendor assessment results data • The Student Profile data display as follows: • For reports that present results data by ADMIN, data valid at the time of testing is used for filters and report content • For reports that present results data for Current Students, current data is used for filters and data valid at the time of testing is used for report content Assessments & Accountability v 1.0

ASSESSMENT REPORTS • Report content for a Program Administration can continue to change as long as suspense processing is occurring for that Program Administration • Students can be added when a new match is made through the Suspense Resolution Process, either online or batch, which updates the AADS immediately • Student demographic data on the report can change when the Suspense Process, either nightly or in a data load, refreshes student data in AADS for students whose data have changed in the ODS (Note: Non-Participant only in Load) • Students can be removed when the Suspense Process, either nightly or in a data load, is not able to re-validate the student’s enrollment due to changes made in ODS enrollment data that were valid at the time of testing Assessments & Accountability v 1.0

UNDERSTANDING STAR REPORTS Assessments & Accountability v 1.0

Understanding STAR Reports INTRODUCTION • The STAR Program has one Administration, called ANNUAL • The ANNUAL Administration includes multiple Assessments: • California Standards Tests (CST) • California Modified Assessment (CMA) • California Alternate Performance Assessment (CAPA) • Standards-based Tests in Spanish (STS) Assessments & Accountability v 1.0

Understanding STAR Reports INTRODUCTION (Cont) • STAR vendor results for the ANNUAL Administration are loaded multiple times • The loads are named P1, P2, P3, and Post P-3 • Loads P2 and P3 overwrite the previous load • The Post-P3 load does not overwrite P3 Assessments & Accountability v 1.0

Understanding STAR Reports GENERAL CALENDAR - STAR Assumption: Results data is loaded to CALPADS within x days of its receipt by CDE Assessments & Accountability v 1.0

ASSESSMENTS & ACCOUNTABILITY