Of standards of learning test security for examiners and proctors
This presentation is the property of its rightful owner.
Sponsored Links
1 / 63

of Standards of Learning Test Security for Examiners and Proctors PowerPoint PPT Presentation


  • 38 Views
  • Uploaded on
  • Presentation posted in: General

S. of Standards of Learning Test Security for Examiners and Proctors. Office of Student Assessment . 2012 - 2013. S tandards o f L earning Tests. High-stakes tests. They represent:

Download Presentation

of Standards of Learning Test Security for Examiners and Proctors

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Of standards of learning test security for examiners and proctors

S

ofStandardsofLearningTest Securityfor Examiners and Proctors

Office of Student Assessment

2012 - 2013


S tandards o f l earning tests

Standards of Learning Tests

  • High-stakes tests.

  • They represent:

    • accountability for student learning.

    • important decisions that can precipitate significant consequences for students and schools.


B uilding security

Building Security

  • Tests, writing prompts, student answer documents, and pre-ID labels MUST remain under lock and key while in each building.

  • The school test coordinator, the assistant principal overseeing testing, and the principal should be the ONLY people with a key to the testing materials.


C ounting materials

Counting Materials

  • Test Booklet and Test Prompt Assembly ID Sheets:

    • must be signed and dated at the time of opening.

    • must reflect whether the identified number of documents were found or whether a discrepancy exists.

    • must identify by serial number (located on the back of the test booklet above the bar code) the missing or extra test booklets.

    • must identify the number of missing or extra writing prompts.


C ounting materials cont

Counting Materials(cont.)

  • Test booklets/prompts/test tickets MUST be counted when signed out to test examiners.

  • Test booklets/prompts/test tickets MUST be counted when signed in from test examiners.

  • The Test Booklet/Prompt Transmittal Form/ Discrepancy Report MUST account for all test booklets/prompts.

  • The online test ticket transmittal form MUST account for all online test tickets.


C ounting materials cont1

Counting Materials(cont.)

  • All test examiners, within the building and homebound, must sign materials out and back in on the same day.

  • No test examiner may keep materials overnight.


D ocument security

Document Security

FOUR SECURITY DOCUMENTS

  • Test Security Guidelines.

  • Virginia General Assembly 22.1-19.1 Actions for violations of test security procedures.

  • Virginia General Assembly 22.1-292.1 Violation of test security procedures: revocation of license.

  • Examiner’s/Proctor’s Test Security Agreement.


D ocument security cont

Document Security(cont.)

  • All test examiners, proctors, and hall monitors must be trained and must sign the state-generated security documents. It is imperative that they read every statement of each security agreement before signing the test security agreement.


D ocument security cont1

Document Security(cont.)

  • Using unreleased test items in any form is STRICTLY PROHIBITED.

  • Copying, printing, or photocopying any test items is STRICTLY PROHIBITED.

  • Scoring student tests, formally or informally, is prohibited.


D ocument security cont2

Document Security(cont.)

  • Examiners may not use the student’s mouse or keyboard to navigate the test for the student

  • Examiners may not prompt students to go back to any questions, including unanswered or flagged for review questions

  • Examiners may tell a student to make sure he/she used the pointer tool to indicate an answer if a questions appears to be unanswered


D ocument security cont3

Document Security(cont.)

  • Help must not be given on specific test items. Examples of prohibited help include but are not limited to: pronouncing words, rewording the question, providing hints and clues, giving reminders, giving verbal indications or non-verbal cues about the correctness of a student’s answer.


D ocument security cont4

Document Security(cont.)

  • Examiners/proctors may not spend time reading any test items, creating any type of answer key to the test items, copying test items or portions of test items, taking notes about test items, recording student responses to test items, or discussing test items with anyone .


Of standards of learning test security for examiners and proctors

Document Security(cont.)

  • Virginia General Assembly 22.1-19.1

  • Actions for violations of test security procedures

  • Permitting unauthorized access to secure test material.

  • Divulging contents of any portion of a secure test.

  • Altering test materials or examinee’s responses in any way.


Of standards of learning test security for examiners and proctors

Document Security(cont.)

Virginia General Assembly 22.1-292.1

Violation of test security procedures:

revocation of license

  • The Board of Education may revoke or suspend the administrative or teaching license it has issued to any person for violation of test security procedures.


D ocument security cont5

Document Security(cont.)

  • All persons are prohibited from providing a student with any type of cues or assistance that could be interpreted as helping him/her with the test. Examiners and proctors may not:

    • answer any questions other than those related to the instructions.

    • use sounds, pointing, or body language to provide a clue or a hint to a student during a test.

    • allow a group of students to leave the test site on their own during testing for any reason.

    • dismiss a student from an online session until his/her test ticket has been collected.

    • dismiss a student from a testing session until his/her test booklet/prompt has been collected.


D ocument security cont6

Document Security(cont.)

  • No testing information shall be discussed between students and/or staff.

    • Test items may NOT be discussed at any time before, during, or after testing.

    • At no time should anyone review/read student writing responses/answer documents.

    • Changing test locations, the test examiner and/or proctor must transport the test materials, and students must not talk to each other.


E xaminer training

Examiner Training

  • All test examiners, interpreters, proctors, and hall monitors must be trained on acceptable test procedures and protocols.

  • Additional personnel should be trained as examiners in the event classroom teachers are absent or an additional examiner is needed for an accommodation group.


E xaminer training cont

Examiner Training(cont.)

  • Examiner’s manuals must be distributed prior to the first day of testing.

  • All personnel who may serve as an examiner or proctor for oral or read-aloud test administrations MUST be provided training on acceptable procedures which may include viewing the Accommodation/ Read-Aloud Test Training video/DVD.


F aculty assistance

Faculty Assistance

  • Non-testing faculty assist in maintaining quiet testing hallways by not allowing non-testing students on those hallways:

    • to visit lockers.

    • to use the restroom.

    • to travel to their next class(es) unmonitored.


G eneral guidelines for testing staff

General Guidelines for Testing Staff

  • Although SOL tests are untimed, they must be completed in one school day.

  • Notify the main office, security desk, and assistant principal in charge of fire drills of the testing schedule.

  • No music can be played during testing.

  • No food, candy, or drink may be present or consumed during testing.


Of standards of learning test security for examiners and proctors

General Guidelines for Testing Staff(cont.)

  • Testing breaks:

    • occur in response to IEP, Section 504, or LEP directives.

    • occur in response to VDOE directions.

    • occur ONLY after test booklets/prompts have been temporarily collected.

    • do NOT include talking or eating.


Of standards of learning test security for examiners and proctors

General Guidelines for Testing Staff(cont.)

Testing Groups

  • Small testing groups with no oral accommodation (neither teacher nor student reads or answers orally), should be no larger than ten students.


Of standards of learning test security for examiners and proctors

General Guidelines for Testing Staff(cont.)

Testing Groups

  • Small oral testing groups should include:

    • no more than seven students.

    • students similar in ability and be small enough that no student is adversely affected by another student’s ability level.


Of standards of learning test security for examiners and proctors

General Guidelines for Testing Staff(cont.)

Reading Directions

In All Settings

  • Examiners MUST be provided with the appropriated Examiner’s Manuals PRIOR to the day of testing.

  • Examiners MUST read and become familiar with the Examiner’s Manual and test-specific directions.

  • Directions MUST be read verbatim.

  • If you make a mistake in reading a direction, stop and say, “No, that was wrong. I must read it to you again. Listen again.”


Of standards of learning test security for examiners and proctors

General Guidelines for Testing Staff(cont.)

Manipulative Use

Calculators

  • Calculators must be only those models identified in the Examiner’s Manuals.

  • Calculators should be the model the student uses daily in the classroom.

  • Graphing calculators must be cleared prior to the start of testing.


Of standards of learning test security for examiners and proctors

General Guidelines for Testing Staff(cont.)

Distributing Materials

In All Settings

  • Test booklets, prompts, scratch paper, and manipulatives MUST be distributed to each student separately.

  • Student names MUST be written on test booklets, writing prompts, and every sheet of scratch paper.


Of standards of learning test security for examiners and proctors

General Guidelines for Testing Staff(cont.)

Collecting Materials

In All Settings

  • Whether in the regular test setting or in an alternate site, at the conclusion of testing, test booklets, prompts, scratch paper, and manipulatives must be collected from each student separately to ensure that all materials are returned, including the same number of pieces of scratch paper as he/she received.


Of standards of learning test security for examiners and proctors

General Guidelines for Testing Staff(cont.)

  • Make-Up Testing

  • Students who miss the non-writing or either portion of the online English: Writing test will use a main test form for make-up testing.


Of standards of learning test security for examiners and proctors

General Guidelines for Testing Staff(cont.)

  • Irregularity Make-Up Testing

  • Students involved in a testing irregularity that necessitates retesting will use an alternate test form for the affected test: writing prompt, writing multiple-choice, and non-writing multiple-choice.


H andling secure test materials

Handling Secure Test Materials

  • The school test coordinator, the assistant principal overseeing testing, or another principal-designated administrator MUST be present when:

    • test booklets/prompts are being distributed to and collected from teachers.


I nstructions for test site preparation

Instructions for Test Site Preparation

  • All instructional materials on walls and windows must be removed OR covered.

  • All instructional materials in the

    hallway

    must also

    be removed

    OR covered.

COVER WITH NEWSPRINT, BULLETIN BOARD PAPER, OR CONSTRUCTION PAPER.


I nstructions for test site preparation cont

Instructions for Test Site Preparation(cont.)

Appropriate Physical Conditions

Place a

“DO NOT DISTURB”

sign on the door

of each testing site.


I nstructions for test site preparation cont1

Instructions for Test Site Preparation(cont.)

  • Test locations should be quiet, well lighted, and ventilated.

  • Arrange desks to provide space for all necessary testing materials: an open test booklet, answer document, and any materials required for the test including any specified accommodation(s).


I nstructions for test site preparation cont2

Instructions for Test Site Preparation(cont.)

  • Desk arrangement should prevent visual access from one student’s work to another.

  • Computer monitor screens must be blocked from view of other students for online testing.


J ustification for accommodations

Justification for Accommodations

  • Students should ONLY receive allowable accommodations they receive on a regular basis in the classroom.

  • Adding new accommodations may impede the students’ ability to demonstrate achievement.


K eep a proctor with an examiner

Keep a Proctor With an Examiner

  • All test sites with students receiving accommodations:

    • Student dictation to scribe on the direct writing test.

    • Any individual student testing.

    • Calculator use.


Of standards of learning test security for examiners and proctors

Keep a Proctor With an Examiner(cont.)

  • All test sites with students receiving accommodations (cont.):

    • Read-aloud test administration.

    • Verbal answer test administration.

    • Student reads aloud to self.

    • Dictation to a scribe.

  • All test sites with oral responses or read-aloud administrations must be tape recorded.


L eaving the room

Leaving the Room

  • Students who leave the testing room to go to the restroom or the clinic may return and complete testing IF:

    • they are accompanied the entire time by an adult.

    • they do not discuss the test.


L eaving the room cont

Leaving the Room(cont.)

  • Test examiners may not leave the room unless another adult trained in testing procedures is present.

    • A plan must be in place to address an emergency situation when a test examiner must leave the room due to unanticipated illness, etc.

    • The plan must include:

      • steps for securing temporary monitoring by personnel trained in testing procedures.

      • STC notification method.


M onitoring test administrations

Monitoring Test Administrations

  • Test examiners and proctors are expected to actively monitor students during the test administration to avoid:

  • Examiners and proctors should not engage in activities that distract them from monitoring students such as:

    • checking email

    • reading

    • grading papers

    • typing, etc.


M onitoring test administrations cont

Monitoring Test Administrations(cont.)

  • students daydreaming/off task,

  • students’ wandering eyes,

  • students using hand-held electronic devices,


M onitoring test administrations cont1

Monitoring Test Administrations(cont.)

  • students using inappropriate manipulatives, and

  • students are not accessing notes or consulting textbooks for information.


N ecessary steps to address irregularities

Necessary Steps to Address Irregularities

  • All irregularities MUST be reported to the STC.

  • The STC will consult with the Office of Student Assessment (OSA) to determine the appropriate course of action.


Of standards of learning test security for examiners and proctors

Necessary Steps to Address Irregularities(cont.)

  • Irregularities that involve retesting are assigned an alternate form of the test.

  • Irregularities that involve a security breach MUST first be reported to the STC.


Of standards of learning test security for examiners and proctors

Necessary Steps to Address Irregularities(cont.)

  • An irregularity occurs when a student:

    • becomes ill.

    • cheats.

    • refuses to test.

    • does not receive IEP-identified accommodations.

    • receives the wrong accommodation.


N ecessary steps to address irregularities cont

Necessary Steps to Address Irregularities(cont.)

  • Irregularities occur when an examiner:

    • provides improper assistance.

    • leaves a test site without another examiner to relieve him/her.

    • turns off the tape recorder during a“read-aloud” session.

    • provides a nonapproved calculator or fails to clear the calculator prior to a test session, if required.


N ecessary steps to address irregularities cont1

Necessary Steps to Address Irregularities(cont.)

  • Serious irregularities occur when:

    • a test book/prompt/pre-ID label is missing.

    • an answer document with demographic information and/or answers is missing.

    • any secure material discrepancy is found during the return of test material to STC.


O nline testing

Online Testing

  • Online test sessions must have at least two adults in the testing location.


Of standards of learning test security for examiners and proctors

Problems With Writing Prompts/Test Items

  • If a student asks a question that refers to the mechanics of testing, it can be answered.

  • If in doubt, when a student asks a question, say, “I can not respond.”


P roblems with writing prompts test items cont

ProblemsWith Writing Prompts/Test Items (cont.)

  • If the student says, "I don't understand this item," the examiner should respond:

    • “Read it carefully and choose the best answer.”

      OR

    • "I can't discuss the item with you, but maybe it would help to return to the item later."

      (See Examiner’s Manual for additional clarification.)


P roblems with writing prompts test items cont1

Problems With Writing Prompts/Test Items(cont.)

  • If during the test a student reports that an item contains an error,

    • the examiner should record the subject area, form number, and item number.

    • under no circumstances should the item be discussed with the student.

    • the test examiner should report the error to the STC.


Of standards of learning test security for examiners and proctors

Scheduling Staff

  • Schedule two adults in each classroom during SOL testing.

  • Schedule two adults in the room for all testing of special education students when the test is not given in the regular education setting. One adult must be an individual who does not work with the student on a regular basis.


Of standards of learning test security for examiners and proctors

Training Staff

  • Students should never be required to use test taking strategies while taking the test.

  • Students should never be required to show their work on scratch paper while taking a test.

  • Scratch paper should never be collected and given to anyone other than the SIS.


U sing appropriate staff

Using Appropriate Staff

  • Teacher assistants may serve as proctors or hall monitors.

  • Parent volunteers may serve as hall monitors on halls where their own children are NOT testing.


V erify information

Verify Information

  • Examiners MUST verify that all necessary information has been coded on each answer document.

  • Examiners MUST verify that information coded on each answer document is accurate.


Your questions

YOUR QUESTIONS??


What if anything is wrong

What, if anything, is wrong?

Find your test ticket and sit down. Audio testers on the left and small group testers on the right.

Examiner

Manual


Of standards of learning test security for examiners and proctors

What, if anything, is wrong?

news.com


Of standards of learning test security for examiners and proctors

What, if anything, is wrong?

Let me see (scrolling), you have items flagged for review. Review your flagged items before submitting.

I know I answered

This question, but it says “unanswered”

I am done with my test.


What if anything is wrong1

What, if anything, is wrong?

CRS OFFICE

Pearson


What if anything is wrong2

What, if anything, is wrong?


Predict

Predict…


Of standards of learning test security for examiners and proctors1

S

ofStandardsofLearningTest Securityfor Examiners and Proctors

Office of Student Assessment

2012-2013


  • Login