1 / 107

Spring 2008 District Test Coordinator Training

Spring 2008 District Test Coordinator Training. New Mexico Public Education Department Assessment & Accountability Division January 2008. Thank You to our Hosts . Speakers. PED, Assessment & Accountability Division Cindy Gregory or Stephanie Marquez Anne Bradley Mona Martin

madelia
Download Presentation

Spring 2008 District Test Coordinator Training

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Spring 2008 District Test Coordinator Training New Mexico Public Education Department Assessment & Accountability Division January 2008

  2. Thank You to our Hosts

  3. Speakers PED, Assessment & Accountability Division • Cindy Gregory or Stephanie Marquez • Anne Bradley • Mona Martin • Robert Romero Harcourt Assessment, Inc. • Diane Najera • Erica Baltierra

  4. Topics • PED & Harcourt Staff Introductions • Review of Agenda • Workshop Objectives • Test Security Training (Review) • 2008 NMSAP Administration • Test Material Packaging (Harcourt Assessment, Inc.) • NMSAP Administration and Packaging Q & A • Data quality and Pre-ID Labels processing • NMELPT & NMELPA Training (Harcourt Assessment, Inc.) • NMELPA Q & A Evaluation Forms and Certificates

  5. Questions & Answers • Please write all questions on cards • Question cards • Questions collected after each segment, answered after last break (except for Harcourt components) • Handouts & powerpoint on PED webpage (January 16, end of day) • Q & As from all sessions on webpage ASAP

  6. Agenda • NMYRRS (Dr. Blair/Lonnie Barraza) • NMELPA (Harcourt) • Break • Test Materials Packaging (Harcourt) • Lunch • Overview of NMSAP • Break • Data Collection and Reporting • Evaluation and Adjournment

  7. Dr. William O. Blair • New Mexico Youth Risk and Resiliency Survey

  8. Training Objectives Participants Should: • Understand the New Mexico Statewide Assessment Program • Review test security and training requirements • Be aware of Changed Procedures for 2008 NMSAP Administrations • Understand the resources used for test administration • Understand how to package and return test materials for the NMSAP • Understand how to process data pretest and during testing • Understand existing and new procedures for NMELPA

  9. 2008 DTC Training Materials You should have the following handouts: 1. Agenda 2. Spring 2008 DTC Training PowerPoint Handout 3. Calendar of Important Dates 4. Test Security Checklist for TAs (From SBA DFA) 5. Test Security Forms (3) 6. SBA Accommodations 7. Sample Draft SBA Biogrid 8. SBA Biogrid Guide Sheet 9. 6.10.7 NMAC (Test Security & Irregularities) 10. Evaluation Form

  10. Senate Bill 561 Under consideration Fall 2007: • Eliminate Grade 9 testing (implemented 2008) • Cut back Science testing to 3 grades (not implemented) • Sunset NMHSCE (2010) (in planning process)

  11. Changes For 2007-2008 • POSSIBLE: • Some tests “on hold” (implemented Grade 11 Spanish Science and Writing) • 3 High School Reform assessments (all in planning) • High School Readiness – Grade 9 • College Readiness – Grade 10 • Workplace Readiness – Grade 11

  12. Acronyms: Tests • NMSAP: New MexicoStatewide Assessment Program • SBA: New Mexico Standards Based Assessment • NMHSCE: New Mexico High School Competency Exam • NMAPA: New Mexico Alternate Performance Assessment • NMELPA:New Mexico English Language Proficiency Assessment • NMELPT: New Mexico English Language Placement Test • NAEP: National Assessment of Educational Progress

  13. Testing Team Acronyms • DTC: District Test Coordinator (public schools) • STC: School Test Coordinator (public schools) • STC: School Test Coordinator (Charter, Special State Supported, and BIE schools) • Acts as DTC at these schools • TA: Test Administrators • Proctors

  14. Public School Sequence: DTC • Receives PED training 2x year • Trains STCs (and Principals) 2x year • Develops District Test Security Policy or Checklist • Ensures Consistency of Test Administration • Creates District Testing Schedule • Receives materials shipments & ships completed materials back to vendor • Communicates with Principals & Superintendent regarding Verification Forms

  15. Public School STCs • Utilize the DTC’s written policy or checklist on test security to train TAs and Proctors on general and daily test security • Train Principals in test administration procedures along with TAs and proctors • Package materials for return to DTC • Checks accuracy of counts using School Security Checklist, biogrids

  16. Charter, Special State Supported & BIE Schools: STC • STC @ these schools perform functions listed for DTC in public schools • Also public school STC training, monitoring of TAs and proctors, and packaging and shipping functions

  17. Quiz Time – Test Security • Is that your final answer?

  18. 6.10.7 NMAC • Statewide Standardized Testing Security Issues and Irregularities • Some other important features: • Superintendent’s Responsibilities • District Test Coordinator’s Responsibilities • School Test Coordinator’s Responsibilities • Staff Responsibilities • Non-disclosure of Student Test Materials • Reporting Test Irregularities • Corrective Measures

  19. 3 Principles of Test Security • Protect the student • Protect yourself • Protect the test

  20. Test Security: Three Basic Activities Test Security is everybody’s responsibility. • Keep test booklets in a locked and secure area before, during, and after testing. • Keep track of and return every test booklet, used and unused. • Report suspected testing irregularities to the DTC or the STC immediately.

  21. Test Security – Essential Elements • Training • Confidentiality Agreement • Locked, central storage • District testing schedule • School Security Checklist • Do not test or proctor relatives • Standardized examination procedures • Reporting security breaches

  22. Test Security and Training • DTCs, STCs, TAs, and Proctors should be familiar with: • Requirements outlined in 6.10.7 NMAC http://sde.state.nm.us/AssessmentAccountability/AssessmentEvaluation/index.html • 2007-08 NMSAP Procedures Manual http://sde.state.nm.us/div/acc.assess/assess/dl/2006-2007%20NMSAP%20Procedures%20Manual_Final2.pdf

  23. Test Security - Training • Training – Required by NMAC • DTC attends PED Workshop twice annually • DTC trains STCs twice annually • STC trains TAs twice annually • Principals must receive training from DTC or STC twice annually

  24. Test Security - Forms • Confidentiality Agreement – for all who come in contact with assessment materials: submitted to principal • Principal’s Verification Form – Verification of proper storage, tracking of materials, trained staff. Submitted to superintendent • Superintendent’s Verification Form – Reviews principals’ verification forms: Superintendent form submitted to PED • Kept at the district for 5 years

  25. Test Security - Materials • Locked central storage – • All testing materials are serialized and accounted for daily • Materials must be signed out by TA daily and be checked-in each day after testing • Must be locked in a centralized room when not in use • Access to locked room must be limited

  26. Test Security – Testing Schedule • District Testing Schedule • Set by the DTC • Must comply with state testing window • All schools follow the same schedule

  27. Test Security - Checklist • School Security Checklist • Provided by STC for daily checking out and checking in of all test materials • Records kept of all check-outs, who, when

  28. TA: Qualifications Only trained, certified staff are permitted to administer tests. Some examples: • Licensed school instructors and administrators • Teachers on waivers or intern licenses • Long-term substitutes with a valid teaching license • Coaches and contractors with a valid teaching license • Licensed counselors and related service providers

  29. TA: Qualifications In the event schools require additional staff to administer the SBA, other trained (non-certified) staff members may be used to: • Provide one-on-one accommodations to Special Education or ELL students • Provide one-on-one administration because of other documented IEP accommodations • Supervised by a certified, trained staff member

  30. Test Proctor: Qualifications Any staff or community member who has been trained in proper test administration and test security may serve as a proctor • Assist, but not act as test administrators • Act as hall monitors • Escort students to and from restroom • A parent cannot serve as a proctor in his or her child’s or relative’s classroom Proctors must sign Confidentiality Agreements.

  31. Test Security - Standardize • Standardized assessment procedures • Thoroughly read all instructions in the Directions for Administration (DFA) manuals • Maintain strict adherence to every element of the directions/instructions

  32. Testing Irregularities • A testing irregularity is: Any circumstance within or beyond the control of a school district that in the opinion of the PED or a school district, raises doubts about the propriety of standardized testing procedures, preparation materials, standardized test administration, standardized testing security, student scores attained from standardized testing, or teacher or student conduct observed during standardized testing. (6.10.7.7 (A) NMAC)

  33. Test Security – Testing Irregularities • Reporting Testing Irregularities • TA immediately reports any testing irregularity to STC • STC immediately reports breach to DTC • District has 3 days to conduct internal investigation • Must officially report breach to PED within 3 days to Assistant Secretary, Assessment and Accountability Division. Phone: 505-827-6683 • Follow-up with written report

  34. Assessment Audits and Monitoring • Annual PED reviews • Spring 2008 • Randomly selected sites statewide • PED sends information about process, expectations, and scoring rubric • PED conducts interview and review of documents on security procedures, TA qualifications, and accommodations

  35. Audits (cont’d) • PED sends report with recommendations and score • Site submits action plan as needed • PED conducts follow-up audit

  36. Title I Monitoring Elements • Evidence of test security procedures • Proper accommodation(s) identification and implementation • NMPED regulatory test procedures and training  (agendas, sign-ins, handouts) • Proper ELL identification, testing and waiver use • Monitoring by the district of test administration in schools

  37. Test Administration Guidelines

  38. 2008 SBA Tests English: • Gr. 3-8 Reading, Writing, Math, Science • Gr. 11 Reading, Writing, Math, Science, & Social Studies Spanish: • Gr. 3-8 Reading, Writing, Math, Science • Gr. 11 Reading, Math

  39. 2008 Changes (1) SBA 1. Grade 9 eliminated 2. Grade 11 Science (English only) becomes operational; standard setting in April 3. Grade 11 Spanish versions of Writing and Science on hold for 2008 4. Accommodations # 12 and #17 suspended for 2008; #13 and #14 are modified 5. SBA Language Waiver process changed

  40. 2008 Changes (2) 6. Writing assessment being scaled, performance levels set, & paper reports provided for all grades. Also changes in administration. 7. The rulers provided by Harcourt for Math can also be used for Science (straightedge for solving Science problems). BIOGRIDs/Pre-ID LABELS (SBA only) 8. Pre-ID labels eliminates most bubbling for public schools, and abbreviates it for BIE schools.

  41. 2008 Changes (3) 9. Standard Settings • Grade 11 Science (English only) in April • All grades Writing in August 10. SBA Reporting • New formats for 2008 print reports • New Item Plot Report 11.PED Webpage • Revised section on Writing • New “Guidelines for Test Interpretation” documents

  42. 2008 Changes (4) 12. May not release any SBA items in 2008 NMHSCE • Grade 11 students who didn’t pass one or more subtests will be allowed retakes in the Fall 2008 window. NMELPA • Kindergarten test revised to be developmentally appropriate. Administered in Spring window only.

  43. 2008 Changes (5) NMAPA • Spring Order window: Jan. 16 – Feb. 8. • New Spring training dates: Feb.19 – 29. • Spring test administration: Mar. 10 – Apr. 25. • Second raters: 10% of students randomly selected statewide will have a second rater. DATA • Graduation 4-year cohort delayed

  44. Spring 2008 Test Windows • High School Graduation: Grade 10+ • NMHSCE - Jan 14 – Feb 1 • NMAPA (as alternate) – March 10 – April 25 • English Language Proficiency • NMELPA (Winter, Grades 1-12) - Jan 14 – Feb 1 • NMELPA (Spring, Grades K-12) – Apr 14 – May 2 • NCLB Assessments • NMAPA (SBA alternate) – March 10 – April 25 • SBA - Feb 25 – March 21

  45. ADMINISTRATION RESOURCES(all will be posted to PED webpage) • Test Manuals (NMHSCE/NMELPA/SBA) TCM: Test Coordinator’s Manual DFA: Directions for Administering • Test Manuals (NMAPA) DTC: District Test Coordinator Manual TAM: Test Administrator’s Manual • 2007-2008 PED NMSAP Procedures Manual General PED procedures for all NMSAP assessments • 6.10.7 NMAC State rules for Test Security and Administration http://www.ped.state.nm.us/div/acc.assess/assess/index.html

  46. Test Coordinator’s Manual (SBA) • Important Dates/Contact Information • Test Security & Reporting Security Breach • Content Areas Tested (E & S) • Recommended Schedule for Testing • Roles & Responsibilities: DTC,STC,TA & Proctors (bullet lists) • Before Testing (Test Security/Materials Received/ Distributing Materials) • After Testing (Materials Used and Packaging Procedures for return to Harcourt)

  47. Test Coordinator’s Manual (cont’d) • Large Print and Braille Test Forms • Administration and packaging for return to Harcourt • Attachments • Scoring Service Identification Sheets (SSID) • Master File Sheets (MFSs): Bldg & District • Sample Grade 8 Biogrid

  48. Directions for Administering (DFA) • About 50 pages of text Pages 3-17 or 18, General Guidelines Pages 18 to end, Content Area Scripts • Received 3 weeks before start of testing window • PDFs posted to PED webpage and Harcourt Spectrum

  49. DFA Contents Organized by • BEFORE Testing, AFTER Testing, Administration Scripts • BEFORE TESTING • Test Security Checklist for TAs • TA qualifications • Preliminary planning (classroom setting, planning accommodations, exceptions)

  50. DFA Contents (p.2) Preparing Test Booklets & Answer Documents • Print student’s name on TB & AD front covers • Add Pre-ID labels/complete biogrid after testing Pages 8 & 9 • Details of administration: Estimated time, Materials Harcourt supplies, Materials School must supply • Rules re use of highlighters, rulers (M & Sci), loose-leaf lined paper for Writing rough draft, no scratch paper of any kind Pages 11 & 12 – Large Print and Braille guidelines

More Related