MCAS Grade 10 Reporting and CD Requirements for Class of 2021

1. 2019 MCAS Grade 10 Reporting and CD Requirements for the Class of 2021 September 10, 2019

2. Presenters • Bob Lee, MCAS Chief Analyst • Scott Kelley, Data & Reporting Specialist • Jodie Zalk, Test Administration Coordinator

3. Logistics for This Session • Questions may be asked at any time using the Questions feature on the GoToWebinar screen. • Questions about a specific student should be sent by email to mcas@doe.mass.edu. • Some questions may be covered during the course of the presentation. • We will answer some questions at the end of this session. • After the session, we will email questions and answers to participants. • This session is being recorded and will be available online in about one week at the MCAS Resource Center.

4. Today’s Discussion • High school Competency Determination (CD) requirements during the transition to next-generation MCAS tests and achievement levels • Yes, it is true that some students in the class of 2021 may be in the “Not Meeting Expectations” level but still earn their CD. • John and Abigail Adams & Koplik scholarship eligibility during the transition • Special reporting and retesting considerations related to the grade 10 ELA voided essay prompt • Review of the MCAS reporting schedule and November retest registration timeline

5. High School CD Requirements 01

6. Interim CD Regulations (Adopted in February 2018) • As determined in 2018, in order to earn their CD, the classes of 2021 and 2022 (this year’s juniors and sophomores) must earn a next-generation MCAS scaled score that is equivalent to a legacy MCAS scaled score of at least 240 on the grade 10 ELA and Mathematics tests or earn the next-generation MCAS equivalent of a legacy scaled score between 220 and 238 and fulfill the requirements of an Educational Proficiency Plan.

7. Interim CD Regulations (Adopted in February 2018) continued • The interim standard was identified in summer 2019 through: • A statistical linking process, and • Validation by a panels of experts • Provides members of the classes of 2021 and 2022 with timely notice of the passing standard and time to become familiar with the new tests and expectations before a new passing standard is established. • Provides time to conduct outreach to students, parents, educators, administrators, and other stakeholders as we move toward a new CD.

8. Statistical Equipercentile Linking Model (ELA) 13% Exceeding Expectations 48% Meeting Expectations % of students 31% Partially Meeting Expectations 8% Not Meeting Expectations

9. Statistical Equipercentile Linking Model (ELA) continued 13% Exceeding Expectations 48% Meeting Expectations % of students 31% Partially Meeting Expectations 8% Not Meeting Expectations

10. A Closer Look at the ELA Cut Score for Passing/Failing Partially Meeting Expectations 472 240 470 EPP required 5% Passing & Not Meeting Expectations % of students 455 220 3% Not Passing & Not Meeting Expectations 440 200

11. Interim CD Standard for the Classes of 2021 and 2022

12. MCAS Achievement Levels • Next-Generation • Legacy Advanced (260-280) Students at this level demonstrate a comprehensive and in-depth understanding of rigorous subject matter, and provide sophisticated solutions to complex problems. Proficient (240-258)Students at this level demonstrate a solid understanding of challenging subject matter and solve a wide variety of problems. Needs Improvement (220-238)Students at this level demonstrate a partial understanding of subject matter and solve some simple problems. Failing (200-218)Students at this level demonstrate a minimal understanding of subject matter and do not solve simple problems. • Exceeding Expectations (530-560)A student who performed at this level exceeded grade-level expectations by demonstrating mastery of the subject matter. • Meeting Expectations (500-529)A student who performed at this level met grade-level expectations and is academically on track to succeed in the current grade in this subject. • Partially Meeting Expectations (470-499)A student who performed at this level partially met grade-level expectations in this subject. The school, in consultation with the student's parent/guardian, should consider whether the student needs additional academic assistance to succeed in this subject. • Not Meeting Expectations (440-469)A student who performed at this level did not meet grade-level expectations in this subject. The school, in consultation with the student's parent/guardian, should determine the coordinated academic assistance and/or additional instruction the student needs to succeed in this subject.

13. Current CD Requirements for ELA and Mathematics, by Class * First administration of next-generation grade 10 tests with new CD requirement in ELA/Mathematics

14. How will this appear on the Parent/Guardian Report? Front Page Inside (Page 2)

15. Adams and Koplik Scholarship Eligibility 02

16. Class of 2021 and 2022 Adams and Koplik Scholarships Adams Scholarship Koplik Scholarship • Score equivalent to Advanced in at least one subject • Score equivalent to Proficient or higher in the remaining subjects • Combined scores in the top 25 percent in their district when they enter 12th grade • Score equivalent to Advanced in at least one subject • Score equivalent to Proficient or higher in the remaining subjects • Meet Koplik standards on 2 AP, SAT II or other tests • See website for details

17. Interim Adams and Koplik Cut Scores for the Classes of 2021 and 2022

18. Special Reporting and Retesting Considerations Related to the Gr. 10 ELA Voided Essay Prompt 03

19. Special Reporting Issues Related to the Voided ELA Prompt • The third operational essay question on the spring 2019 grade 10 test (about a passage from the novel The Underground Railroad) was voided during test administration. • Students who had not finished the essay were told to skip it. • Student essays were not scored. • The ELA operational test was reduced from 59 to 51 points. • An independent study was conducted to see if the performance of African American students declined after the voided prompt.

20. Study Results • The independent study concluded that the question: • showed that while black students experienced a small difference (approximately 0.006 standard deviations) in performance as compared to white students on the second day of the MCAS ELA test, that small difference was within the normal variation of such differences on past MCAS tests.

21. Special Considerations • The Department gave scores of 455, the minimum passing score, to all students in the state who were on track to pass prior to the prompt. (This applied to 61 students.) • Other students who believe they were affected by the prompt will be allowed to take the November 2019 MCAS ELA retest for consideration for the Adams and Koplik scholarships. • Additional guidance on this opportunity will follow shortly.

22. Review of the MCAS Reporting Schedule and November Retest Registration Timeline 04

23. Preliminary Release – Data Currently Available

24. Upcoming Release Dates (Tentative)

25. Student Registration for the November Retests • Schools will complete the Student Registration/Personal Needs Profile (SR/PNP) for the November retests: • September 23–October 4: Regular registration period • October 7 –10: Window to register additional students retesting for ELA (if needed) • Guidance will be provided in the next Student Assessment Update. • SR/PNP training session on September 19 • Register at http://www.doe.mass.edu/conference/?ConferenceID=10087

26. Questions & Answers (Use the “Questions” feature to ask questions.)

27. Next Steps • Today: Complete the evaluation form. • Responses associated with the name and email address used to log in • Email your input to mcas@doe.mass.edu if you have problems accessing or completing the form. • Later this week/early next week: • Receive an email with the Q&A from this session • Recording will be available

28. THANK YOU The Office of Student Assessment Services 781-338-3625 mcas@doe.mass.edu www.doe.mass.edu/mcas 75 Pleasant Street, Malden, MA 02148