0 likes | 13 Views
ELPA21's 2024-25 updates include adjustments in cut scores, domain exemptions, item development, Alt ELPA screener, and future K/Grade K windows. There are reminders on Alt ELPA administration, upcoming item development focusing on higher difficulty, and changes in scoring for the future K screener. Notable updates also cover honoring student proficiency renewal requests and domain exemptions. The importance of administering tests listed in IEPs and monitoring IDEA non-compliance is highlighted.
E N D
English Language Proficiency Assessment (ELPA) Informational Webinar 2024-25 Ben Wolcott, ELPA Specialist Introduction
Testing in 2023-24 • Remote ELPA Summative window extended. • Domain Exemptions on ELPA: Definitions and Examples updated. • Now hews closer to federal language (“precludes assessment”). • Future K and Grade K cut scores adjusted. • Current average proficiency rates: 12% Future K, 14% Grade K • Dictation and Word Prediction activated for ELPA tests. 3 2023-24 In Review
Other updates in 2023-24 • No ELPA21 EL Toolkit supplement in 2023-24. • I said there would be one, but I was wrong. Supplements are not released every calendar year. • I have not yet seen confirmation that a supplement will be released in 2024-25. • Potential IDEA non-compliance added to test impropriety process. • This increased monitoring is a federal requirement. • EL Designations from Other States implemented. • TN joined the ELPA21 consortium. 4 2023-24 In Review
2024-25 5
Alt ELPA Screener • ELPA21 is developing an Alt ELPA Screener. • Pilot version will be available to interested states August 2024. • Consonant with recommendations from advisory panels, OR did not opt in to this pilot administration. There was insufficient lead time to: • Review instrument. • Inform districts and facilitate training. • Review and customize supporting materials. 6 2024-25
Alt ELPA Reminders (repeat from 2023) • The IEP is a legal document. • If a test is listed in the IEP, administer it. • If a test is not listed in the IEP, don’t administer it. • Reexamine domain exemptions for Alt ELPA. Do not assume that exemptions previously present on the ELPA Summative will be appropriate on the Alt ELPA. Alt ELPA window: 1/14/25 – 4/11/25 7 2024-25
Item Development • Now gearing up again after a lull in 2023-24 • Targets: • Less-measured standard/domain combinations • Higher difficulty (to better measure higher proficiency) • There will be field test items on both the ELPA Summative and the Alt ELPA • Because the Alt ELPA has 10 questions per domain, even a few field test items will notably increase the length of a domain test. 2024-25 8
Future K / Grade K Screener Windows • Future K ELPA Screener test window • March 1 — opening of Grade K window each year • Grade K ELPA Screener test window • ELPA Summative opening date (early January) — late July each year In 2024, TIDE will go offline at the end of the day on Friday 7/19. The Screener will reopen on Thursday 8/1. 9 2024-25
K Screener Scoring and Cut Points • Future K Screener • Current profile: “3-3-3-3” is Proficient (all non-exempt domains must be 3 or higher) • 2025-26 profile (following verification study): “4-4-4-4” is Proficient (all non-exempt domains must be 4 or higher, like every other grade band) • Studies • ELPA21 to perform a Screener cut score study in 2024-25 • ODE verification study • Current, lower cut points are temporary estimations • Live exercise with educators in 2025 will confirm or improve these estimations • Scheduled as pre-conference activity at March 2025 COSA Multilingual and English Learner conference 10 2024-25
Past ELPA21 Studies Cut scores for ELPA Summative (Summer 2023): • All domains, all grade bands • Used data ELPA and state summative content area tests (like ELA) from several ELPA21 states, including OR Findings: • Correlating ELPA21 performance with performance on other summative content area tests suggests that ELPA Summative cut scores are in the right location. Interpretation: • No action is needed with ELPA Summative cut scores. 11 2024-25
Honoring Student Proficiency Renewal Request • Current approval expires after 2024-25 • ODE plans to request renewal for uninterrupted service, and: • Add Alt ELPA • Add Grades 6-8 • Request permanent authorization (rather than another 5-year waiver) • ELPA21 states continue to express interest in this policy; could extend consortium- wide in the future. • In 2023-24, test results appeared in official ODE data applications, then scoring was completed for Honoring Student Proficiency (a week later). • In 2024-25, scoring for Honoring Student Proficiency will complete first, then records will appear in official ODE data applications (no incomplete scores). • CRS remains unofficial. 2024-25 12
Honoring Student Proficiency and Domain Exemptions • Domains carried per Honoring Student Proficiency are listed in the “HS ELPA Proficiency Met” tool in the Test Information Distribution Engine (TIDE). • This tool populates each year in mid-December. • In 2024-25, TIDE will not permit domain exemptions that eliminate the last testable domain. Instead, an error message will appear. • If special circumstances require exemption of all non-carried domains, please contact ODE. • Remember that carried domains “drop” if the student does not test! 13 2024-25
Domain Exemption Errors • If a domain exemption error is made, there are only two options: Reset or Invalidate • The erroneous domain cannot be exempted or excluded after the test has opened • It cannot be removed from scoring • It cannot be retaken by itself and reinserted into the test • A Reset may be appropriate if district investigation supports all the following: • The student did not receive an unfair advantage or disadvantage that will persist into a new testing opportunity. • There are no test security concerns. • Retesting does not pose the student potential harm or undue hardship. 14 2024-25
ELPA Standards Report • ODE-produced report that presents ELPA Summative data in a different way • School- or district-level performance on combinations of domains and ELP standards (ex. Listening Standard 2) • ELPA version of ELA/Math Target Reports • Scheduled to be available for tests taken 2024-25 • Data validation completes in August • Training, instructions, and support material still to be developed 15 2024-25
AI Scoring • No ELPA test currently uses any kind of AI scoring in OR. • AI scoring will be used in some ELPA21 states for Speaking and Writing constructed responses on the ELPA Screener only. • OR elected not to participate in this pilot, but will be interested to see the resulting data. • So far, the proof of concept shows AI scoring to match or exceed the reliability of human scoring across all domains and grade bands. 16 2024-25
ELPA21 Interim • ELPA21 confirms project for development of an ELPA interim instrument • LA is the lead state for this project • Project originally set to launch January 1, 2024 • Progress hindered by turnover in key positions; development has not yet begun • ODE has asked for an ELPA interim “standing item” with regular updates in ELPA21 meetings 17 2024-25
Questions and Answers 18 Wrap-up
Need in-depth help? For help with interpreting policies, diagnosing system problems, or retrieving scores, contact your Regional ESD Partner. For step-by-step help with a technical problem, contact the OSAS Helpdesk. 19 Wrap-up
Contact Information ELPA Summative and Screener contact: Ben Wolcott English Language Proficiency Assessment Specialist ben.wolcott@ode.oregon.gov For Alt ELPA, also contact: Mason Rivers Special Education Assessment Specialist mason.rivers@ode.oregon.gov 20 Wrap-up