Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.
2009 MEPA Reporting Teleconference September 2009
Presenters • Kit Viator, Director of Student Assessment • Dan Wiener, Administrator of Inclusive Assessment • Bob Lee, Chief Analyst
Welcome MEPA Overview and Updates 2009 MEPA Reporting: What’s New and Why? New Performance Levels and Reporting Scale Standard Setting: Setting the Cut Score What the Scores Mean Making Reclassification Decisions Planning Instruction Important New Resources Questions and Answers Today’s Agenda
MEPA Overview • The state’s English language proficiency assessment of LEP students in grades K-12, based on English Language Proficiency Benchmarks and Outcomes • MEPA-R/W and MELA-O • Fall testing: Test only those LEP students in grades 1-12 who did not participate in spring 2009 (no fall testing for Kindergarten) • Spring testing: Test all students in K-12 reported as “LEP” in October 2009 or March 2010 SIMS • Sub-scaled scores in four tested areas • Reading: 0-30 points • Writing: 0-30 points • Listening: 0-5 points • Speaking: 0-20 points NOTE: Sub-scaled scores Overall scaled score
By January 31, 2010, all QMT/QMAs must be requalified in order to continue to report MELA-O scores for MEPA Purpose: To improve consistency and reliability of student ratings Fall 2009 QMT Training schedule Retrain current QMTs: October 13, Westborough Train new QMT (if no QMT in district): September 21-22, Westborough November 3-4, Norwood MELA-O (Listening and Speaking)QMT/QMA Retraining and Requalification
Spring 2009 MEPA:What’s New? • Redesigned tests for grade spans 3-4, 5-6, 7-8, and 9-12 • New K-2 tests • New test questions based primarily on authentic reading passages • Wide range of difficulty of test questions, and more constructed responses • Locator survey (K-2)/locator tests (3-12) • New reporting scale: 400-550 • New performance levels: Levels 1-5
New Tests for Students in K-2 • Student takes either Level A or B, depending on • Level of English proficiency and literacy • Results of K-2 Locator Survey • What’s tested on K-2 MEPA-R/W: • Level A:(R) alphabet recognition; match high-frequency words with pictures; answer questions based on story read aloud; (W) write or complete a dictated word; write the word for a picture; write a two-sentence story • Level B:(R) match or write a word/sentence that matches picture; questions based on story read by student; (W) correct punctuation; letter writing to complete sentence; write a story based on 3 pictures
MEPA Reporting: 2005-2008 MEPA Performance Levels Early Inter-mediate Inter-mediate Beginning Transitioning 300 400
Why We Needed New MEPA Performance Levels 2005-2008 MEPA Early Inter-mediate Inter-mediate Beginning Transitioning 305 395 400 300 Many students begin to demonstrate proficiency on MCAS ELA tests
MEPA 2005-2008: Distribution of Scaled Scores • Students at low Beginning and high Transitioning levels were clustered into lower and upper ends of scale. 5,000 4,000 3,000 # STUDENTS 2,000 1,000 0 300 320 340 360 380 400 SCALED SCORE
MEPA Reporting: 2009 MEPA Performance Levels Level 2 Level 5 Level 3 Level 4 Level 1 400 550
New MEPA Performance Levels A student at: • Level 1 cannot yet communicate in English • Level 2 communicates using simple written and spoken English, with frequent errors • Level 3 communicates using basic English with occasional errors • Level 4 is generally fluent, with few errors • Level 5 communicates effectively in English across all academic subjects
Standard Setting: Summer 2009 • Performance levels describe performance at five levels • Panels of ELL and general educators spent 3 days last summer with ESE determining where one performance level ended and another began (“cut score”) • Recommendations of panelists for Levels 1-4 were adopted. • Level 5 was based on panelists’ recommendations plus other evidence, including • Percent of LEP students Proficient on MCAS ELA • Statewide reclassification rate …and was fixed at 500-550 on each test.
2009 MEPA Grade K-12 Overall Scaled Score Distribution 400 # STUDENTS 550 SCALED SCORE
Level 3 Level 5 Level 4 Level 1 Level 2 Sample Parent/Guardian Report: Grade 7 • Very similar in appearance to 2005-2008 P/G Report, showing: • student’s score • location within the performance level • likely range of scores if student took the test multiple times
Sample Parent/Guardian Report: Grade 7 (Continued…) • Relative strengths and weaknesses in four tested areas
Sample Parent/Guardian Report: Grade 7 (Continued…) • Score compared with other students who have been in Massachusetts for 1 to 5+ years • About 45% of students who have been in Massachusetts for 3 years were in Level 3 on this MEPA test, as was this student.
Using MEPA Results to Make Reclassification Decisions • Level 1 and Level 2: Not a candidate for reclassification • Level 3: Not a likely candidate for reclassification • Level 4: May be a candidate for reclassification, if other indicators are aligned* • Level 5: Reclassification recommended, if other indicators are aligned* *MCAS scores, grades, local assessments, observations
Available Now • Guidance on Using MEPA Results to Plan Sheltered English Immersion (SEI) Instruction and Make Reclassification Decisions for Limited English Proficient (LEP) Students (2009) • Guide to Interpreting the 2009 MEPA Reports for Schools and Districts (Both available at: www.doe.mass.edu) • School “Drop Box” with pre-loaded student results for 2009 MEPA and 2008-2009 MCAS (Department’s Secure Internet Portal)
Accessing MEPA Results • Go to www.mcasservicecenter.com • Click “MEPA” • Then “MEPA Reporting” • Then “Continue” • Log In
Accessing MEPA Results (Continued…) • Choose your district from the dropdown menu • Select your school or District Office from the school menu • Enter your MCAS/MEPA five-digit password and login
Accessing MEPA Results (Continued…) • Select “All Grades” under Administration • Check the reports you want to view; then “Download” • If you have trouble viewing the zipped files, click the blue “here” link for help uploading free unzipping software
Accessing “Dropbox Central” for Principals or their designees • https://www4.doemass.org • Log in with your Security Portal password • Principals and those assigned the MEPA school role by your directory administrator can access “Dropbox Central” • Select the “2009 MEPA and 2008-2009 MCAS” folder • Download the .TXT file which can be opened using Excel or other spreadsheet software