1 / 52

QualityCore –Spring 2013 Test Administration Training January 28, 2013

QualityCore –Spring 2013 Test Administration Training January 28, 2013. Joe Dell Brasel, Ed.D. Principal Consultant ACT Atlanta Office joedell.brasel@act.org. Jennifer Stafford Policy Advisor Kentucky Department of Education Jennifer.stafford@education.ky.gov. Agenda. What’s New

moke
Download Presentation

QualityCore –Spring 2013 Test Administration Training January 28, 2013

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. QualityCore –Spring 2013 Test Administration TrainingJanuary 28, 2013 KDE:OAA 1/23/2013 Joe Dell Brasel, Ed.D. Principal Consultant ACT Atlanta Office joedell.brasel@act.org Jennifer Stafford Policy Advisor Kentucky Department of Education Jennifer.stafford@education.ky.gov

  2. Agenda • What’s New • Constructed Response Announcement • Testing Windows and Sessions • Responsibilities and Deadlines • Accommodations • Materials • Group Headers • Labels • Answer Documents • Return Shipping • Prohibited/Acceptable Materials • Resources KDE:OAA 1/23/2013

  3. What’s New • When students are tested • Constructed Response shift to local administration • Multiple Choice test format combination • KDE/ACT upload of student accounts • Window 6 (June 16-July 16) Computer Based Testing Only KDE:OAA 1/23/2013

  4. When Students are Tested • Policy Change: Students are tested at the completion of all coursework. • No longer calculate if 55% KDE:OAA 1/23/2013

  5. New Features Currently Available • Batch printing for student reports (directions shared in January 7 DAC Monday E-mail) • Combined MC/MC into one booklet In Development • iPad application KDE:OAA 1/23/2013

  6. End-of-Course - Dual Purpose • Instruction • Objectives • Syllabus • Course Outline • Instructional Units • Formative Item Pool/Benchmark Assessments • Accountability • Student • School • District • State KDE:OAA 1/23/2013

  7. Issues with Constructed Response • Critical for Instruction • Super Scale Score • Student Motivation • Security of CR Items • Logistics • State Guidelines • Two Separate Scores • Paper Based Testing KDE:OAA 1/23/2013

  8. Local Administration Instructional Value • Constructed Response administered locally will render more instructional value. • Students, parents, teachers have student work to score and analyze. • Teachers can identify strengths and weaknesses in student writing. • Instruction can be based on current data. KDE:OAA 1/23/2013

  9. Constructed Response Shift to Local Administration • Constructed Response will not be part of state administered assessment. • Students will take multiple choice sections for state accountability. • Schools will receive Scale Score (MC/MC). • The 2012-13 grading scale aligns more closely to the performance levels (NAPD). • Schools can have a better idea of performance levels. KDE:OAA 1/23/2013

  10. Constructed Response Shift to Local Administration (continued) • Constructed Response should be administered at the local level • Local administration and scoring • Included in student’s final exam grade • Instructional Value • Encourage schools to revisit EOC policies • Review the policy which created the percentage of the EOC into the student’s grade KDE:OAA 1/23/2013

  11. Constructed Response Shift to Local Administration (continued) • Local staff may obtain from various locations • Formative Item Bank (Vantage System) • Benchmark Assessment (Vantage System) • Local Source • Text Book • Locally Developed • Open Source KDE:OAA 1/23/2013

  12. Constructed Response Shift to Local Administration (continued) • Materials Order process will be the same without constructed response. • Computer Based testing for EOC would yield no shipment from ACT. Support materials and manuals are available online. • For paper based testing, schools will only receive one Answer Sheet and one set of student labels. • It will simplify returning materials. • For computer-based testing of multiple-choice items, student results are available in the online system within 24 hours. KDE:OAA 1/23/2013

  13. Constructed Response Implications Window 4February 1 – March 15 Window 5 & 6April 15-June 15 & June 16-July 15 Constructed Response test booklets will not be shipped by ACT DACs will not receive CR test booklets Manuals will reflect change • Constructed Response test booklets will be shipped by ACT in early part of window • DACs hold at district office • Manuals do not reflect change KDE:OAA 1/23/2013

  14. Two Sessions KDE:OAA 1/23/2013 • Two separate EOC sessions • Multiple Choice 1 (Paper or Computer) • Multiple Choice 2 (Paper or Computer) Policy Change: School staff may choose to combine paper and CBT for Multiple Choice. • Sessions are 45 minutes each • Paper sessions are timed by the test administrator. • Computer sessions are timed automatically by the computer.

  15. Testing Sessions • Paper Testing: • ALL students must be tested at the same time, in the same content area. • Computer Testing: • Multiple testing sessions can be utilized in a single day. • New Policy: The first computer based test must begin at the same time as the paper based test. • Note: A 10-15 minute break is allowed between test sessions. KDE:OAA 1/23/2013

  16. Testing Windows (Includes Paper and Computer Testing) KDE:OAA 1/23/2013 • Six EOC test windows per year • August 1-September 15 (new) • October 1-November 16 • December 1-January 15 • February 1-March 15 • April 15-June 15 • June 16-July 15 (Computer Based Only) • Within each window, schools choose a 10-day window (consecutive days) to complete the four tests, including make-up sessions. • Within the 10-day window, schools choose 1 day per content area. • MC1 and MC2 must be given in order on the same day. • May schedule multiple content tests on same day.

  17. Non-Traditional Windows (Includes Paper and Computer Testing) KDE:OAA 1/23/2013 • SixEOC test windows per year • August 1-September 15 (new) • October 1-November 16 • December 1-January 15 • February 1-March 15 • April 15-June 15 • June 16-July 15 (Computer Based Only) • Within each window, schools choose one day per student(s) to complete sessions. • MC1 and MC2 must be given in order on the same day. • May schedule multiple content tests on same day.

  18. Traditional vs. Non-Traditional? • High Schools with only Traditional Courses: Use school’s 10-day window • Alternative Schools with only Non-Traditional Courses: Use State’s broader window • Schools with both Traditional and Non-Traditional Courses: Use both school’s 10-day and State’s broad window KDE:OAA 1/23/2013

  19. Steps for Ordering • Confirm Unit Usage (DACs/Designee) • Create/Upload Users & Teachers (DACs/Designee) • Create/Upload Students (KDE/ACT, Local) • Create Class Test Rosters (Local) • Finalize Class Rosters (Local) Note: Valuable Resources are located at: www.act.org/stateservices/kentucky KDE:OAA 1/23/2013

  20. Responsibilities • District or School Administrator: • Conduct Administration Code and Inclusion Training • Confirm Unit Usage per school • Determine Paper or Computer Testing • Estimate Number of Students Testing • No automatic overage. DAC/BAC should order additional tests per school. • Determine Testing Dates • Create/Upload Students (New enrollees) KDE:OAA 1/23/2013

  21. Create and Upload Students • KDE will extract from Infinite Campus (IC) students enrolled in IC at the high school level within each district. • ACT will create student accounts at the appropriate school. • Student grade levels will reflect current status in IC. Accounts for students enrolled after this date will need to be created by the school. Note: Middle school students taking courses for high school credit will not be included. KDE:OAA 1/23/2013

  22. Create and Upload Students (continued) • KDE/ACT Upload of student accounts • Spring—Data pull from IC Dec. 15 in Vantage early February • 2012 High School Graduates will remain in the Vantage system for one year. KDE:OAA 1/23/2013

  23. Responsibilities • School Administrator: • Create Class Roster Name: • Options • Name by school, course, teacher, and period • i.e. CCHS, Algebra II, C. Greer, period 5 • Name by school, course, per teacher • i.e. CCHS, Algebra II, C. Greer • Name by school, course • i.e. CCHS, Algebra II • Note: Separate class roster for extended time for computer based (specific timing). KDE:OAA 1/23/2013

  24. Responsibilities • School Administrator or Teacher: • Finalize Class Rosters • Verify all students to be tested are on roster • No roster in SDRR at this time • Print or save electronic copy to use as a reference for accountability in SDRR at the end of school year. • Create seating chart KDE:OAA 1/23/2013

  25. Test Form Changes KDE:OAA 1/23/2013

  26. Target Dates KDE:OAA 1/23/2013 *Finalize Class Rosters must be completed four (4) weeks plus one day prior to testing. Other dates are targets for workload management.

  27. Target Dates KDE:OAA 1/23/2013 *Finalize Class Rosters must be completed four (4) weeks plus one day prior to testing. Other dates are targets for workload management.

  28. Special Populations Regulation • Inclusion of Special Populations in the State-Required Assessment and Accountability Programs • No changes to the Inclusion of Special Populations Regulation (February 2009) • Accommodations must be identified in a student’s Individualized Education Program (IEP), 504 Plan or Program Services Plan (PSP) to be provided on the End of Course assessment KDE:OAA 1/23/2013

  29. Accommodated Testing Paper Only Paper and Computer Extended Time Paraphrasing Manipulatives Prompting/Cueing Behavior Modification Interpreter (sign language) Dictionaries/Thesauri • R = Reader • A = Audio • B = Braille • LP = Large Print • Scribe KDE:OAA 1/23/2013

  30. Ordering Accommodated Test Materials • Navigate to http://www.act.org/stateservices/kentucky • Select the Resources tab (top right side of screen) • Select Test Accommodations (left side of screen) • Download and complete the KDE Accommodated Testing Materials Order Form. Once the order form is completed, e-mail it to qualitycorecustomerservice@act.org Note: This process is for accommodated materials, not test booklets. Paper units must be allocated to the school and students must be on finalized roster for order to be complete. KDE:OAA 1/23/2013

  31. Ordering Accommodated Test Materials Deadline KDE:OAA 1/23/2013 • This includes ordering of reader scripts. • Fax Form to QualityCore Customer ServicesForm available at: http://www.act.org/stateservices/kentucky/accommodations.html

  32. Exemption Types • Medical Exemption choice requires more detailed information, including Date of Diagnosis and Hospitalization. More detailed descriptions are needed for approval. • Extraordinary Circumstance (Other Exemption) choice has open field to enter information. • For both types of exemptions, see the associated Medical Exemption and Extraordinary Circumstance forms on the KDE web site and in the Forms section of the DAC/BAC. • SDRR will be open for exemption applications in Spring. KDE:OAA 1/23/2013

  33. Exemption Information • Student identifying information • Name • SSID • Grade • Gender • DOB • School Name • Test Type • Exemption Type • Explanation of Medical or Extraordinary issue • Relevant dates Keep paper form on-file in the district. Enter information electronically into SDRR. KDE:OAA 1/23/2013 An Exemption Request is NOT automatically approved.

  34. Receiving/Storing MaterialsFebruary 1 – March 15 • Shipment going to DACs will be identified with course name, school and BAC’s name for easy distribution • Check shipment contents • Testing Boxes • Test Booklets • Miscellaneous Boxes • Two Answer Folders (MC1/MC2 and CR) • Pre-ID Labels • Reference Sheets--Algebra II • Test Supervisor’s Manual (MC) and Room Supervisor’s Manual (one per 25 students (MC)) • School Header • Group Header • Box 1 Contains Packing List Store SECURELY LOCKED storage KDE:OAA 1/23/2013 Discrepancies—Call (866)764-7228

  35. Group Headers • One per class, per roster • One for MC1/MC2 • Example: If Ms. Jones has 3 Algebra II classes, there will be 3 separate Group Headers. • 3 MC Group Headers KDE:OAA 1/23/2013

  36. B: Test Roster Name D: Vantage Test Assignment Roster ID

  37. Information for Group Headers Test Roster Name Vantage Test Assignment Roster ID KDE:OAA 1/23/2013

  38. Pre-ID LabelsFebruary 1 – March 15 • Arrive in Miscellaneous Box(s) • One per student answer folder • MC1/MC2 • Errors on label • Do not edit • Make corrections online within class roster • No Label • Add new students online KDE:OAA 1/23/2013

  39. Answer Document and Labels Do not bubble student information Affix label to answer folder.

  40. Return Shipping:Group Headers Group Header 1 KDE:OAA 1/23/2013 MC/MC English 10

  41. Return Shipping KDE and ACT recommend return shipping from the school. • Packing • Envelopes • Used Answer Documents (MC1/MC2) • Testing Irregularity Report • Instructions on pages 12-17 of Test Supervisor’s Manual • Boxes • Used and unused tests booklets in the boxes stamped with their course names • Unused answer documents and manuals in the boxes stamped “Miscellaneous” • Instructions on pages 12-17 of Test Supervisor’s Manual KDE:OAA 1/23/2013

  42. Packaging and ShippingApril 15 - June 15 • One document per student per test • Test booklet pre-printed with student and teacher name • Answer sheet pre-filled with student information • Answer sheet bound as perforated sheet into test booklet • Reference Sheet for Algebra 2 bound as perforated sheet into test booklet • One document per Test Supervisor • Test Supervisors Manual • Pre-filled School Header • Pre-filled Group Rosters • All shipped from the printer • More information to come on what shipment will look like KDE:OAA 1/23/2013

  43. Window 6: June 16-July 15 • Policy Change: Computer Based Testing Only • Return of student scores • Guarantee from ACT to provide accurate data • Ensures students’ scores will be included in accountability KDE:OAA 1/23/2013

  44. Supplemental Order Process • E-mail: qualitycorecustomerservice@act.org • Quantity needed per course • See example below: MASON COUNTY SCHL DIST MASON COUNTY HIGH SCHOOL Biology suborder 8233 10 tests Eng 10 suborder 8232 4 tests May 5—May 16 KDE:OAA 1/23/2013

  45. Irregularities • A disturbance or distraction occurs that could affect one or more students’ scores. • A student becomes ill and discontinues testing. • A student questions or challenges a test item. • A student uses unauthorized testing aids. • Complete a Testing Irregularity Report (Test Supervisor’s and Room Supervisor’s Manuals) KDE:OAA 1/23/2013

  46. Materials Computer Pencil/Paper Prohibited Scratch paper Notes Foreign language or English dictionary Electronic devices and cell phones Allowed Scratch work is to be done in the test booklet. Calculators Reference Sheets (Algebra II) Prohibited • Notes • Foreign language or English dictionary • Electronic devices and cell phones Allowed • Scratch Paper-Please collect and destroy securely. • Calculators • Reference Sheets (Algebra II) KDE:OAA 1/23/2013

  47. Practice Online Testing • Coordinate with District Technology Coordinators to verify workstations are ready for online testing • CBT Launch Demo PPT • QC CBT QuickStart LaunchTest • Teachers/Students may use the Launch Demo to practice the system. KDE:OAA 1/23/2013

  48. KDE:OAA 1/23/2013

  49. Test Security • Appropriate training for Administration Code and Inclusion Regulations • Signatures on Administration Code and Inclusion Training • Seating charts that reflect everyone in each testing room (adults and students) KDE:OAA 1/23/2013

  50. Seating Chart KDE:OAA 1/23/2013

More Related