1 / 99

Spring Test Administration Training Session

Spring Test Administration Training Session. January/February 2014 Includes information on MCAS, MCAS-Alt, ACCESS for ELLs, and the PARCC field test. Presenters. Dan Wiener Administrator of Inclusive Assessment Jodie Zalk Coordinator of MCAS Test Administration

glora
Download Presentation

Spring Test Administration Training Session

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Spring TestAdministration Training Session January/February 2014 Includes information on MCAS, MCAS-Alt, ACCESS for ELLs, and the PARCC field test

  2. Presenters • Dan WienerAdministrator of Inclusive Assessment • Jodie ZalkCoordinator of MCAS Test Administration • Bob LeeMCAS Chief Data Analyst Massachusetts Department of Elementary and Secondary Education

  3. Today’s Agenda • Review materials in folders • Planning for 2014 PARCC field tests • Test security and test administration protocols • Participation requirements • Students with disabilities • ELL students • Reporting • Additional information and orientation for new principals Massachusetts Department of Elementary and Secondary Education

  4. Board Approved Transition Plan • Spring 2014: PARCC field test to be administered in randomly selected schools • Spring 2015: MA districts choose PARCC or MCAS • Fall 2015: Board votes on assessment plan • Current Competency Determination (CD) requirements in place through class of 2018 • Any change after class of 2018 requires future Board approval Massachusetts Department of Elementary and Secondary Education

  5. Spring 2014 PARCC Field Tests • Most schools in Massachusetts participating • Approx. 81,000 students in 1,075 schools in 345 districts • Two test administration modes: • paper-based testing (PBT) • computer-based testing (CBT) • Two components/testing windows *grade 10 students only doing EOY Massachusetts Department of Elementary and Secondary Education

  6. Who Is Allowed to Be Exempted from MCAS in 2014?  = Superintendents were allowed to exempt classrooms from MCAS in that subject. Massachusetts Department of Elementary and Secondary Education

  7. PARCC Resources • Spring 2014 PARCC field test training sessions • Teleconference slides • Accessibility and accommodations resources Web: www.parcconline.org andwww.doe.mass.edu/parcc Email: parcc@doe.mass.edu Massachusetts Department of Elementary and Secondary Education

  8. Test Security

  9. Why Is MCAS Security Important? • To protect the validity and integrity of test results “When MCAS scores are invalidated, parents, students, educators, and the community are deprived of important information about student achievement...” --Commissioner Mitchell D. Chester, Spring 2012 Massachusetts Department of Elementary and Secondary Education

  10. Most Common Security Issues • Cell phones • Facebook • Instagram • Twitter • Improper use of the read-aloud accommodation (#26) • Cheat sheet/copying • Working in wrong session • Asking another student for help • Improper calculator use • Passing notes • Accessing Internet while using typed response accommodation (#23) • MP3 players Massachusetts Department of Elementary and Secondary Education

  11. Importance of Leadership • Superintendents must review their principals’ test security plans. • Superintendent’s Assurance of Proper Test Administration (optional form) — PAM page 114 • Principals must maintain the security of the testing environment and test materials. • PCPA certification — PAM pages 112–113 • Train test administrators and others, and ensure they comply with requirements. • Meet with students. Massachusetts Department of Elementary and Secondary Education

  12. A Secure Testing Environment • Plan for • appropriate testing spaces • students who may need more time • lunch, recess, restrooms • Cover/remove prohibited classroom displays • PAM page 26 • No unauthorized visitors Massachusetts Department of Elementary and Secondary Education

  13. Security Requirements for Test Materials • Store all test materials in a central location each day. • Locked when tests are not being administered • Restricted access • Maintain chain of custody of materials during test administration. • Do not remove test materials from school. • Do not leave test materials unattended. Massachusetts Department of Elementary and Secondary Education

  14. Confidentiality of Booklets Do NOT … • review test booklets or answer booklets before, during, or after testing • exceptions for certain accommodations • provide students access to tests before testing • duplicate test materials • retain, recycle, remove, or destroy test materials Massachusetts Department of Elementary and Secondary Education

  15. Case Study #1 After administering MCAS tests to her students, the test administrator locks their materials inside her desk until Session 2 the next day. The test administrator completes the tracking form and keeps it with the materials in her desk. Is this permitted? Massachusetts Department of Elementary and Secondary Education

  16. Is this permitted? • Yes. Materials were securely stored. • No. Materials were not returned to the central secure storage area and they were not signed in.   Massachusetts Department of Elementary and Secondary Education

  17. Train Test Administrators and Others • All individuals involved in test administration must participate in training. • See topics in PAM — pages 29–31 • Forms requiring signoff by test administrators • Participated in training • Received their TAMs — see PAM page 119 • Signed a nondisclosure agreement if providing certain accommodations — see PAM page 117 Massachusetts Department of Elementary and Secondary Education

  18. Test Administrator Responsibilities • Follow directions in TAMs and read scripts verbatim. • Supervise students at all times to prevent cheating. • Prevent use of prohibited materials (e.g., cell phones). • Focus full attention on the testing room. • Do not coach students or alter responses. Massachusetts Department of Elementary and Secondary Education

  19. Case Study #2  During the Composition, a student asks a test administrator the meaning of a word in the writing prompt. The test administrator tells him. Is this permitted? Massachusetts Department of Elementary and Secondary Education

  20. Is this permitted? • No. The test administrator should have given the student a dictionary – no help is permitted. • Yes. The test administrator is clarifying the word, just as he would during regular instruction.   Massachusetts Department of Elementary and Secondary Education

  21. Give Clear Instructions to Students • Before testing, instruct students to • try their best • respond directly to the MCAS ELA Composition prompt • TAMs instruct students • to work until end of session (and only in that session) • to answer all questions in the session Massachusetts Department of Elementary and Secondary Education

  22. Test Security Requirements for Students • During testing, students must NOT … • preview test materials • copy others’ work or communicate with other students • ask for or accept any coaching • let someone else answer for them • work in a different test session • use materials that are prohibited during testing (e.g., notes, cell phones – including post messages online) • See PAM page 121 for reasons for invalidation. • See PAM page 120 for sample form to document students’ understanding of requirements. Massachusetts Department of Elementary and Secondary Education

  23. Results will be invalidated for students who use cell phones or other electronic devices at any time during a session, including after a student turns in his or her test materials, during a break, or during the transition to a test completion area. Massachusetts Department of Elementary and Secondary Education

  24. Case Study #3 A test administrator notices a student has finished working but hasn’t turned in her test materials. The test administrator notices that the student has her phone out. The test administrator confiscates the phone, collects the student’s test materials, and sends the student to the principal’s office. Upon questioning, the student admits that she took a photo of a drawing she had made in her test booklet, and posted the photo to Twitter. What should the principal do? Massachusetts Department of Elementary and Secondary Education

  25. What should the principal do? • Print a copy of the photo. • Have the student delete the photo from Twitter and from the phone. • Determine whether the photo was disseminated in another way (e.g., email, texting, Facebook). • Call the Department immediately. Massachusetts Department of Elementary and Secondary Education

  26. How to Avoid This Situation • Inform students about the cell phone policy, including consequences for having one during testing. • Plan for end of session: • Inform students of appropriate activities at the end of a session. • See PAM page 28 for list of materials permitted after a student has turned in test materials. • Have test administrators collect test materials when students are done. • Schedule sessions for appropriate lengths of time. • Use dismissal waves in scheduling. Massachusetts Department of Elementary and Secondary Education

  27. Tips to Maintain Security (Recommended) • Use seating charts. • Have an empty seat between students. • Whenever possible, • Assign test administrators for other teachers’ classes OR • Have two test administrators in each room Massachusetts Department of Elementary and Secondary Education

  28. Please contact the Department at 781-338-3625 IMMEDIATELY to report testing irregularities. • See PAM pages 6–7 for more information about reporting testing irregularities. Massachusetts Department of Elementary and Secondary Education

  29. PARCC Test Security Requirements • Requirements similar to MCAS: tests are secure • Same security requirements for computer and paper administrations • Not an opportunity for educators to view content • Important even though no results reported from 2014 field test Massachusetts Department of Elementary and Secondary Education

  30. Test Administration Protocols

  31. Determine Logistics • Develop school’s security plan. • Plan school’s testing schedule. • Testing dates and deadlines • Daily schedule, including dismissal waves • Testing locations and staffing plan (including special populations) • Prepare record of test administrators and students. • Check the Department’s website. • Practice tests • SAS Update • Read the PAM. • Student participation guidelines Massachusetts Department of Elementary and Secondary Education

  32. Review Data for March SIMS • Students’ names • changes • Demographic information • first-year LEP, IEP, and 504 status • Grade levels Students are reported as absent if they are enrolled but not tested. Massachusetts Department of Elementary and Secondary Education

  33. Review CD Data (High Schools Only) • Check lists of students who are in grade 12 to confirm • Who has not been tested? • Who still needs to earn a CD? • Check CD report • Posted in Edwin Analytics on January 9 • Includes November retest results and October SIMS • Check list of students in grade 11 who were in grade 9 the previous school year • To be posted in School and District DropBoxes by February Massachusetts Department of Elementary and Secondary Education

  34. Receive Test Materials • Complete forms. • Internal tracking forms (sample – PAM pages 115–116) • Materials Summary • Principal’s Certification of Proper Test Administration (PCPA) – www.mcasservicecenter.com • Order additional materials if necessary. • Deadlines listed on PAM pages iii–v • Prepare materials for distribution. • Distribute manuals during training session. • Affix Student ID Labels to answer booklets. Massachusetts Department of Elementary and Secondary Education

  35. Order STE Materials (High Schools Only) • High schools: Order June STE materials • March 10–14, 2014 • www.mcasservicecenter.com Massachusetts Department of Elementary and Secondary Education

  36. June High School STE Participation Massachusetts Department of Elementary and Secondary Education

  37. Be Sure to… • Distribute and track test materials. • Monitor and coordinate test administration. • Securely store materials between sessions and after each day of testing. • Remind test administrators to read scripts verbatim. • Keep a log of test administrators and students. Massachusetts Department of Elementary and Secondary Education

  38. Prepare Materials for School Files • Retain your school’s test administration files for three years. • Records may be requested in the event of an investigation. • Lists of materials to retain: • PAM pages 52–53, 71–72 Massachusetts Department of Elementary and Secondary Education

  39. Prepare the Scorable Shipment • Assign an answer booklet for • students who participated in ANY part of testing • students who were absent with medical documentation • first-year ELLs • Transcribe responses if necessary • Prepare envelopes • Return, Special Handling, Void • Packing diagrams and instructions in PAM • ELA: PAM pages 48–51 • Math and STE: PAM pages 67–70 Massachusetts Department of Elementary and Secondary Education

  40. Returning MCAS Materials for Students Participating in PARCC • MCAS answer booklets for grades 5 and 8 STE will have Math sections blank. • For students who were exempted from taking MCAS • Keep log of students participating in PARCC. Massachusetts Department of Elementary and Secondary Education

  41. Complete Forms after Testing • Internal tracking forms • Materials Summary • PCPA • Signature must match the name of the principal in School/District Profiles (http://profiles.doe.mass.edu). Massachusetts Department of Elementary and Secondary Education

  42. Options for Returning Materials (March–April and May) Massachusetts Department of Elementary and Secondary Education

  43. Schedule Your School’s Pickup • Two methods: • Schedule online at mcasservicecenter.com. • One day prior, and by 3:00 p.m. OR • Give cartons to your regular UPS driver. • Call to inform the MCAS Service Center (800-737-5103). • Grade 10: Call the Service Center to cancel early pickup if using regular return. • Do not take materials to UPS. • Do not leave materials unattended. • Use UPS labels specific for each administration. Massachusetts Department of Elementary and Secondary Education

  44. Return Shipments for MCAS and PARCC Materials • Different testing contractors for MCAS and PARCC: • Ship MCAS materials back to Measured Progress in NH. • Ship PARCC materials back to Pearson. Massachusetts Department of Elementary and Secondary Education

  45. Questions & AnswersShort Break

  46. Participation for Students with Disabilities

  47. Updates for 2014 • New sample form for documenting an accommodation was offered but refused • Page 30 of participation manual www.doe.mass.edu/mcas/participation/sped.pdf • New guidelines and form for accommodation 20 • www.doe.mass.edu/mcas/participation/?section=sped • Manipulatives (accommodation 30), assistive technology devices, external software (math programs) must be approved by the Department Massachusetts Department of Elementary and Secondary Education

  48. Assigning MCAS Accommodations • IEP or 504 plan must specify which accommodations will be used for testing. • Accommodations may not be provided if an IEP is not yet signed by the parent/guardian. • Notification, but no parental approval, required for 504 plans • Include a description of accommodations, not just accommodation numbers. • (e.g., accommodation 25: other – slant board) PAM Appendix B — www.doe.mass.edu/mcas/testadmin/ Participation requirements — www.doe.mass.edu/mcas/participation/?section=all Massachusetts Department of Elementary and Secondary Education

  49. Prohibitions for Test Accommodations Test administrators must NOT … • Provide incorrect accommodations – e.g., those not listed • In a student’s IEP or 504 plan • In Appendix B of the PAM • Provide a different grade-level test • Alter, photocopy, or scan a test booklet • Coach or provide clues/assistance • E.g., define words, explain questions, suggest the student write more • Allow prohibited materials – e.g., • Dictionary or thesaurus on ELA Reading Comprehension test • Unapproved math reference sheet Massachusetts Department of Elementary and Secondary Education

  50. Accommodations Irregularities Providing a student with: • Accommodations not listed in the last approved IEP or an expired 504 plan • Accommodation 26 to a student who only has accommodation 16 • A graphic organizer or Math reference sheet that was not submitted to the Department for approval • Access to a calculator on a noncalculator session • An English-language dictionary • Dictionaries are only allowed for the ELA Composition Massachusetts Department of Elementary and Secondary Education

More Related