2012/2013 Winter Keystone Exams Assessment Coordinator Training

1. 2012/2013 Winter Keystone Exams Assessment Coordinator Training Pennsylvania Department of Education Data Recognition Corporation

2. 2012-13 Keystone Exams will be used for two purposes: Proposed state requirement that the class of 2017 and beyond demonstrate proficiency for the purpose of graduation Accountability as per No Child Left Behind (NCLB) Adequate Yearly Progress (AYP) PDE plans to apply for new Annual Measurable Objectives (AMO) Currently 89% for math and 91% for reading K E E X Y A S M T S O N E

3. Available to students either online or paper/pencil • Comprised of two (2) modules • Multiple-Choice (MC) and Constructed-Response (CR) items • Students who attempt a Keystone Exam but do not score proficient or above are permitted to retake the Keystone Exam Keystone Exams Overview

4. Keystone Exams Overview • Students in grades 9-11 will be required to take the Keystone Exams at least one time prior to (or during) the spring administration of their grade 11 year. • In 2012-13, Grade 11 Keystone results will be used for Adequate Yearly Progress (AYP). • Grade 9 and 10 results will be banked. • Students who attempt the Winter Keystone Exams but do not score proficient or above are permitted to retake the Keystone Exams during the spring 2013 window.

5. Keystone Exams Overview For AYP Purposes: • If an 11th grade student took a Keystone Exam in 2011 as a 9th grade student and scored Advanced or Proficient, the results of that Keystone Exam will be used for purposes of accountability. • A student who did not score Advanced or Proficient in Algebra or Literature as a 9th grade student in 2011 should retest as an 11th grade student in 2012-13. • A student who participated in the Biology exam in 2011 does not have to retest in 2012-13.

6. PDE Policy – Test Security • The assessments rely on the measurement of individual achievement. Any deviation from assessment procedures is strictly prohibited and will be considered a violation of test security. • School administrators, teachers, and any other education personnel who are involved in the assessment program must maintain the security of all assessment materials at all times. • Because the assessment must remain secure, teachers/Test Administrators should not have assessment materials in their possession at any time other than during the actual assessment administration.

7. PDE Policy – Test Security Test Security Certifications • The Test Security Certifications must be signed after the assessments are administered • Principal, District Assessment Coordinator, School Assessment Coordinator, Test Administrator and Proctor (if applicable) • Provided in Appendix D of Handbook for Assessment Coordinators • All other individuals handling secure materials MUST have a signed School Assessment Coordinator Test Security Certification on file • The Chief School Administrator must retain all Certifications for three years • DO NOT return these forms to DRC

8. PDE Policy – Test Security Test Security Certifications • If an individual does not sign the appropriate Test Security Certification, the Chief School Administrator must provide the Department of Education’s Bureau of Assessment and Accountability with a written explanation of the reason or reasons why the Certification was not executed.  The explanation must provide a description of the action taken by the Chief School Administrator in response to the failure to execute the Test Security Certification.

9. PDE Policy – Test Security PAsecureID List Distribution • School assessment coordinators must generate a list(s) of students by PAsecureID to show all students taking the Keystone Exams. • The list should include for each student the test administrator, school name, year, and subject being administered. • All lists must be retained at the district/school for three years; and be available when requested by PDE.

10. PDE Policy – Test Security • Maintain test security: Refer to PDE security guidelines located at www.education.state.pa.us Search for “Accommodations and Security”

11. Roles and Responsibilities • Test Administrators • Be familiar with all testing protocols, including the “Ethical Standards of Test Administration (formerly the “DO’s and DON’Ts”) • Follow all testing protocols • Sign the Test Security Certification Statement • Make students familiar with testing procedures • Make students feel comfortable

12. Roles and Responsibilities • Test Administrators • Answer any questions students may have about test directions • Walk around the room during testing • Maintain a calm, quiet environment during testing • Collect and return test books to the SAC when testing is complete • Report any suspected testing violations to the SAC and to PDE

13. Common Violations The following are examples of testing violations. This is NOT an exhaustive list. • Misuse of accommodations (e.g., reading the Math test to the entire class; reading aloud the Reading test) • “Under” proctoring (e.g., inadequately monitoring the testing session) • “Over” proctoring (e.g., reminding a student without the appropriate accommodation to answer a specific question)

14. Common Violations • Changing answers or encouraging students to change their answers. • Discussing the test or test questions with individual students. • Reading aloud a math question or answer choice when doing so cues the correct answer.

15. Common Violations • Not removing or covering instructional materials in the testing room or the hallways. • Giving reminders to individual students or to the entire class (e.g., “Remember, we covered this last week.”) • Allowing students to possess cell phones during testing. • Allowing devices in the testing room that take pictures.

16. Common Violations • Copying or recording any part of the secure test materials • Viewing secure test material by teachers, proctors, administrators, etc. • Returning test materials to students to complete or enhance answers

17. Potential Consequences of Testing Violations For Educators: • Verbal reprimand • Written reprimand • Suspension with or without pay • Termination • Revocation of certification • Criminal charges

18. Potential Consequences of Testing Violations For Students: • Consequences for students violating test security (e.g., cheating, taking pictures of test questions) are up to the individual LEA. • Students should be made aware of these consequences prior to testing.

19. Potential Consequences of Testing Violations For Students (cont.) • If a student violates test security, it is the responsibility of the LEA to determine the consequences for the student. These consequences may include disciplinary action and/or the student retaking the test. • ALL test security violations by students must be reported to PDE immediately.

20. Data Available to PDE- examples • Student erasures • How long it takes a student to answer an item when taking the test on a computer • When answers are changed and how often they are changed on a computer • Statistical analyses of student scores and performance

21. Cautions! • Do actively proctor the test but don’t give any individual student help. • Do encourage the class to check their answers but don’t encourage specific students to check their answers. • Do report all prohibited actions.

22. Cautions! • Do not review student test or answer booklets (except as stated in the Administration Manual and the Accommodations Guidelines). • Do not assist, direct, or counsel students during the administration of the test in any way that would influence student answers. • Do not provide answers to students. • Do not alter, influence, or interfere with a test response in any way, fill in any unanswered item, or instruct the student to do so. • Do not discuss or provide feedback regarding test items. • Do not use the answer sheet as scratch paper or as a method to eliminate incorrect answer options.

23. To Report Suspected Violations, Contact The Pennsylvania Department of Education at 717-787-4234

24. Assessments Available • Algebra I • Biology • Literature • Accommodations are available for all tests.

25. DO: • maintain calm & quiet • remove or cover all instructional materials • provide: • blank scratch paper • sharpened pencils • highlighters • encourage students • return all test materials to secure location DO NOT: • allow unsupervised breaks • display visual cues (e.g., picture icons) • provide pre-printed graphic organizers • allow pens/colored pencils; stray marks • prompt students • keep any test materials • use the answer sheet as scratch paper Administering the Assessment

26. 2012-13 Keystone Exams • Accountability (Federal requirement) • All 11th grade students must take all three Keystone Exams* • All non-11th grade students completing a Keystone related course must take the appropriate Keystone Exam • Only 11th grade results will be used to calculate AYP • Non-11th grade students’ results will be banked until they’re in 11th grade

27. PDE-established Testing Window Wave One Test Dates – All subjects • Testing window: December 3-14, 2012 • Return all paper tests by December 19, 2012 Wave Two Test Dates – All subjects • Testing window: January 9-23, 2013 • Return all paper tests by January 25, 2013 Make-ups can occur anytime during the PDE-established window. Last day to return materials to DRC for all Keystone reporting is January 25, 2013

28. Data Recognition Corporation understands the intricacies involved with large scale assessments. Our customer service representatives are always ready and willing to help with any questions or problems. Our number is 1-800-451-7849 Or email us at pacustomerservice@datarecognitioncorp.com PA CUSTOMER SERVICE