1 / 24

March, 2014

NYC DOE Office of Academic Quality EOY MOSL Assessment Administration and Scoring Process & MOSL Updates. March, 2014. Session Approach and Norms. High Engagement, Low Tech – Please turn cell phones on silent.

oksana
Download Presentation

March, 2014

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. NYC DOE Office of Academic Quality EOY MOSL Assessment Administration and Scoring Process & MOSL Updates March, 2014

  2. Session Approach and Norms • High Engagement, Low Tech – Please turn cell phones on silent. • Contribute to the Learning – Throughout the afternoon, write any outstanding questions on index cards and place them in the center of your table. Q&A at the end of the day will address these and any other lingering questions. • Maximize Our Time Together – Be Mindful of “Airtime”— Use this day to collaborate, troubleshoot and brainstorm with your colleagues. Save complex, individual questions for other avenues of communication and support.

  3. Objectives   • Participants will gain a high-level understanding of the step-by-step process schools must complete to successfully administer and score EOY assessments centered on the EOY Assessment Administration Checklist Participants will create an End-of-Year MOSL Implementation Plan

  4. Where to Begin? EOY MOSL Assessment Administration Handbook • Online guide, located on the Intranet • One-stop, comprehensive resource that organizes all guidance related to administering and scoring MOSL assessments. • Numerous hyperlinks to all relevant resources. • Organized according to implementation step and assessment: • Plan for EOY administration • Prepare and administer • Score and submit Take 3-4 minutes to orient yourself to the handbook. Please note that information connected to specific page numbers in the EOY Handbook and related materials are subject to change pending the final release of the EOY MOSL Assessment Administration Handbook.

  5. Review MOSL Selections & EOY MOSL Assessments • Review your school specific MOSL Selections • Review the MOSL Assessments in yellow on the right of your spreadsheet • The yellow highlighted area identifies the specific MOSL assessments your school is required to administer by grade based on your MOSL selections

  6. Understanding EOY Administration and Scoring 1 • Plan for Administration and Scoring • Keeping your MOSL Selections & EOY Assessments in mind, take 10 minutes to independently review the: • Overview for Principals (P. 2-3) • End-of-Year Assessment Calendar for Advance (P. 4-5) • NYC Performance Assessments- End-of-Year Assessment Topics • AdministratorEOY MOSL Assessment Checklist (P. 7-11) • Note any questions that arise. • Which steps might be the most challenging for your school? 2 • Prepare Assessments 3 • Administer Assessments 4 • Prepare for Scoring 5 • Score 6 Submit Scores 7 Archive Assessment Materials

  7. Navigating the EOY Assessment Administration and Scoring Handbook 1 • Overview of the Handbook’s Structure • EOY Checklist- The entire Handbook is organized into this 7-step process. The Checklist can help you navigate to the information you need, serving as a table of contents for the document. You can click on the orange headers to link to the assessment specific information you need. • Each section of the Handbook serves as a stand-alone resource: • Overview for Principals • Calendar Planning Tool • Four administration and scoring guidance documents: • NYC Performance Assessments • Running Records • FAST • Scantron Performance Series • Plan for Administration and Scoring 2 • Prepare Assessments 3 • Administer Assessments 4 • Prepare for Scoring 5 • Score 6 Submit Scores 7 Archive Assessment Materials

  8. Step 1: Plan for EOY Administration and Scoring 1 • Review windows for printing, administration, norming and scoring If necessary, consider additional dates and times for norming and scoring EOY assessments. • If relevant, consider content of NYC Performance Assessments and ensure assessment schedule is aligned with course curricula. • Identify and schedule key EOY administration tasksand assign roles and responsibilities, including: • Perform roster verification • Confirm/ update Teacher-Level MOSL Selections in the Advance Web Application (functionality tentatively available March 24th) • Share Teacher Assessment Administration Checklist with teachers • Scheduleassessment printing, administration, norming and scoring activities • Plan for Administration and Scoring 2 • Prepare Assessments 3 • Administer Assessments 4 • Prepare for Scoring 5 • Score 6 Submit Scores 7 Archive Assessment Materials

  9. New Resource Spotlight: Calendar Planning Tool Pgs. 12-15 1 • Plan for Administration and Scoring • Designed to support principals and assessment coordinators to create an end-of-year assessment implementation calendar for their school. • Contains action steps and templates that will help identify key tasks and dates. • Includes a calendar template with key milestones highlighted to support school leaders integrate these EOY MOSL tasks into existing timelines and structures. 2 • Prepare Assessments 3 • Administer Assessments 4 • Prepare for Scoring 5 • Score 6 Submit Scores We will look at the Calendar Planning Tool more closely later in the training and allow time for you to create an EOY Advance implementation plan. 7 Archive Assessment Materials

  10. New Resource Spotlight: Teacher Checklist 1 • Plan for Administration and Scoring • Similar to the EOY MOSL Assessment Checklist (P. 7-11), but shares relevant EOY assessment information tailored to teachers • Contains specific action items aligned to each of the 7 steps. • Teacher Checklist has been released on the Advance intranet page and is included in your folder. 2 • Prepare Assessments 3 • Administer Assessments 4 • Prepare for Scoring 5 • Score 6 Submit Scores 7 Archive Assessment Materials

  11. Step 2: Prepare Assessments • Each assessment requires different preparation steps. • Depending on the assessment, specific tasks may include the following: • Select and download certain online assessment(s). • Print or request assessment materials (FAST) • Receive or select texts • Print ATS score sheets (when necessary) • Ensure teachers have the relevant materials necessary to administer the assessment (assessment tasks, texts, etc.) • Check technical and audio requirements for specific assessments(Scantron Performance Series) • Obtain log-in information (FAST & Scantron Performance Series) 1 • Plan for Administration and Scoring 2 • Prepare Assessments 3 • Administer Assessments 4 • Prepare for Scoring 5 • Score 6 Submit Scores 7 Archive Assessment Materials Locate and review Step 2 for at least one of your EOY MOSL Assessments and review the steps for “Prepare Assessments”. (Refer to P. 8 in the handbook to identify the page for the assessment you’re looking for.)

  12. Step 3: Administer Assessments 1 • Each assessment requires different administration steps. • Depending on the assessment, specific administration tasks may include the following: • Ensure the security of testing materials • Follow administration guidelines in the Handbook and or in the assessment system • Collect assessment materials. • Note: Even if multiple teachers in your school are evaluated on the same assessment, students should only take each assessment once. • Plan for Administration and Scoring 2 • Prepare Assessments 3 • Administer Assessments 4 • Prepare for Scoring 5 • Score 6 Submit Scores 7 Archive Assessment Materials Locate and review Step 3 for at least one of your EOY MOSL Assessments and review the steps for “Administer Assessments”. (Refer to P. 9 in the handbook to identify the page for the assessment you’re looking for.)

  13. Steps 4 and 5: Prepare for Scoring and Score • Scoring Overview: • Scoring requirements vary greatly from one assessment to another. • Depending on the assessment, specific scoring tasks may include the following: • Norm scoring practices • (NYC Performance Assessments, FAST, Running Records) • Review scoring policies • Finalize scoring schedule • Coordinate “school-based distributed scoring” for all assessments (except FAST and K-2 Math NYC Performance Assessment) • For assessments that do not require distributed scoring, administrators must review and approve assessment results. Approval is indicated on an Assessment Results Approval Form (P. 78) .(FAST, K-2 Math Performance Assessment) 1 • Plan for Administration and Scoring 2 • Prepare Assessments 3 • Administer Assessments 4 • Prepare for Scoring 5 • Score 6 Submit Scores 7 Archive Assessment Materials

  14. Steps 4 and 5: Prepare for Scoring and Score • Distributed Scoring: • State teacher evaluation law stipulates that teachers with a “vested interest” cannot score the assessments of students they directly teach. Whenever “practicable” schools must establish processes whereby other teachers would score a teacher’s MOSL assessments. • Because this scoring policy is not practicable for FAST or K-2 Math NYC Performance Assessments,teachers using these assessments as their MOSL are permitted to score their own students' assessments. • The NYCDOE has outlined a process for administrator review of these scores (Assessment Results Approval Form P. 78). 1 • Plan for Administration and Scoring 2 • Prepare Assessments 3 • Administer Assessments 4 • Prepare for Scoring 5 • Score 6 Submit Scores 7 Archive Assessment Materials 15

  15. Steps 4 and 5: Prepare for Scoring and Score 1 • Plan for Administration and Scoring • Distributed Scoring- Who is Eligible to Score? • It is preferred that assessments be scored by teachers who hold a license in the subject areaand/ or are currently teaching the subject area. Principals, APS, Achievement coaches or other network staff may participate in scoring at the discretion of the network and principal. • Teachers may score assessments from grades that they are not currently teaching. For example, a 9th grade ELA teacher may score a 10th grade ELA assessment. 2 • Prepare Assessments 3 • Administer Assessments 4 • Prepare for Scoring 5 • Score 6 Submit Scores 7 Archive Assessment Materials 16

  16. Steps 4 and 5: Prepare for Scoring and Score 1 • Scoring Guidelines: • In accordance with the state regulations, the DOE recommends that schools choose from one of the following scoring models: • Option 1: Teachers in the same grade and subject swap to score end-of-year assessments. • Option 2: Teachers of the same subject in different grade levels swap to score end-of-year assessments. • Option 3: At the principal’s discretion, teachers who are properly normed in an end-of-year assessment may score. • Clusters and networks will establish structures to support schools where the options listed above are not feasible (i.e. schools where there is only one content area teacher for the whole school). • Plan for Administration and Scoring 2 • Prepare Assessments 3 • Administer Assessments 4 • Prepare for Scoring 5 • Score 6 Submit Scores 7 Archive Assessment Materials 17

  17. Steps 4 and 5: Prepare for Scoring and Score • Group Norming Sessions for NYC Performance Assessments*: • Schools should conduct norming sessions after administering but before scoring the assessment in order to ensure that all teachers have a common understanding of the rubric and increase fairness of the scoring process. • Group norming sessions should follow this process (approx. 2-3 hours): • Step 1: Review the rubric and discuss expected performance at each performance level for each rubric trait. • Step 2: Review annotated sample student work and discuss the evidence for each score. • Step 3: Individually score one EOY assessment, then discuss as a group the evidence for each score. • Step 4:Collectively score several students’ NYC Performance Assessments and come to consensus on a score for each trait.  The scorer ID for these collectively scored papers can be 999999. • *Norming scoring practices are also recommended for Running Records and FAST." 1 • Plan for Administration and Scoring 2 • Prepare Assessments 3 • Administer Assessments 4 • Prepare for Scoring 5 • Score 6 Submit Scores 7 Archive Assessment Materials

  18. Steps 4 and 5: Prepare for Scoring and Score ? ? 1 • Plan for Administration and Scoring • Review the norming steps found on page 32 for the writing prompt, pg. 46 for running recordsinthe • EOY Assessment Handbook. • Why is it so critical that teachers scoring the NYC Performance Assessment are properly normed? • Why is this also considered a best practice for Running Records and FAST? 2 • Prepare Assessments 3 • Administer Assessments 4 • Prepare for Scoring 5 • Score 6 Submit Scores 7 Archive Assessment Materials Locate and review Steps 4 & 5 for at least one of your EOY MOSL Assessments and review the steps for “Prepare for Scoring & Score”. (Refer to P. 9-10 in the handbook to identify the pages for the assessment you’re looking for.)

  19. Step 6: Submit Scores 1 • Plan for Administration and Scoring • Submitting Scores- Overview: • Scores for different assessments are submitted through different systems. • Depending on the assessment, specific submission tasks may include the following: • Scan ATS Score Sheets • Submit Scores in respective data systems • AssessmentPro • STARS Classroom • SANDI & FAST Online Portal • Generate reports and fix errors. 2 • Prepare Assessments 3 • Administer Assessments 4 • Prepare for Scoring 5 • Score 6 Submit Scores 7 Archive Assessment Materials Locate and review Step 6 for at least one of your EOY MOSL Assessments and review the steps for “Submit Scores”. (Refer to P. 10 in the handbook to identify the pages for the assessment you’re looking for.)

  20. Step 7: Archive Assessment Materials 1 • Plan for Administration and Scoring • Sign the MOSL Assessment Material Security Form (P. 72) • Archive Assessment Materials • It is the responsibility of the school to retain and store all Advance assessment-related materials. Assessments, student work, data collection tools, scanning confirmation pages and Assessment Results Approval Forms should be organized by course and section and stored in an accessible, secured location by the principal, assessment coordinator or designee for a minimum of three years. 2 • Prepare Assessments 3 • Administer Assessments 4 • Prepare for Scoring 5 • Score 6 Submit Scores 7 Archive Assessment Materials Locate and review Step 7 for at least one of your EOY MOSL Assessments and review the steps for “Administer Assessments”. (Refer to P. 11 in the handbook to identify the pages for the assessment you’re looking for.)

  21. Updates • K-2 NYC Performance Test ELA Texts • Math Double Testing Waiver for Grade 7 & 8 Students in Accelerated Courses • Calendar Change Requests • Advance Implementation Funding: SAM 60 • Teacher Level Selection Tool

  22. Activity: Creating an EOY MOSL Implementation Plan • Sample MOSL Selections • Review the Calendar Planning Tool and the Advance EOY calendar. • Begin planning for End-of-Year MOSL assessments at your school. • Additional Planning Support: 2013-2014 MOSL End-of-Year (EOY) Assessment Analysis and Next Steps Tool 1 • Plan for Administration and Scoring 2 • Prepare Assessments 3 • Administer Assessments 4 • Prepare for Scoring 5 • Score 6 Submit Scores 7 Archive Assessment Materials

  23. Thank you! • Lori Ann O’Connor, Senior MOSL Implementation Specialist Office of Academic Quality, Cluster 6 • loconno@schools.nyc.gov • Office (718) 420-5659 • Cell (646) 696-8170

More Related