FIFTY Shades of Training Proctors and Invigilators for Standardized Test Administration

1. FIFTY Shades of Training Proctors and Invigilators for Standardized Test Administration Granit ZELA Albanian Test Team Head STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017

2. Agenda • Standardized test administration validity • Invigilator training goals, role, aids/activities • Invigilator responsibilities: prior, during, at end of the test 4. Test cheating: test theft, test cheating methods STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017

3. Standardized Test Administration Validity Test Administration in the Garden of Eden The cheating “Crib Garment” STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017 STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017 3 3 3

4. Standardized Test Administration Validity • Test administration according to standardized procedures: uniform testing conditions - uniform test administration 1. The invigilator at one test centre who shows students to their seats is rude and aggressive. 2. Five venues are selected for a speaking test during the summer. One of these is next to a major road where extensive road works have just begun. STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017

5. Training goals • Fully comprehend what is expected of them for the test administration • Be confident in roles and responsibilities as invigilators • Understand regulations for running tests • Be able to act appropriately in any given circumstances STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017 5 5

6. Invigilator Training • Invigilation training must be mandatory • Tools, knowledge and experience to successfully invigilate • Introduces invigilation practices to perform to the highest level • Addresses trainees concerns • Provides tips and insights STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017 6

7. Invigilator Training aids Power point slides/DVD Links to resources Discussion activities Training notes Information sheets Quizzes Videos Test fraud scenarios Invigilator Handbook STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017 7

8. Prior to testing • Appropriate signage • Acoustic conditions, heating, lighting, ventilation • A quiet testing environment • Clock placed in prominent position • Candidate warning posters • A room seating plan • A Test Checklist of testees • Stationery equipment distributed • Right question papers and candidate materials • Know to operate the equipment • A tested method of calling for assistance STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017 8

9. Prior to testing • Test is in progress as soon as candidates enter the room. • Check the identification of each candidate. • Ensure all mobile phones and electronic devices are handed in • Remove any unauthorised materials from candidates and place • Make sure candidates are seated according to your seating plan. • Check that they have the items they need for the exam. • Distribute test materials • Give clear instructions about the test completion, time limits • State clearly the policy on cheating and theft. • Know procedure for late arrivals STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017

10. During the testing • Observe candidates all the time • Move around the room • Respond when a candidate asks for help • No advice about the content of the test paper • Look out for any malpractice or candidates looking unwell • Be vigilant for use of hidden electronic communication • If a candidate is disruptive remove them from the room while you resolve the issue. • Maintain the required number of invigilators. • . STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017 10

11. Ending the exam • Inform candidates of the remaining time • Tell candidates to stop writing. • Collection of all materials • Complete relevant documentation • Be committed to test material security • Do not read or allow anyone else to read any of the scripts • Collect any unused stationery or equipment. • Hand the scripts and attendance register • Emergency situations • Leave the scripts and question papers in the exam room • Evacuate the room STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017 11 11 11

12. Traditional malpractice examples • Notes hidden • calculator back • the pencil case • inside Juice box • under the patch • under the sleeves • at a headscarf • in the back of the tie • in the back of the shoe • water bottle label cover • in a tampon • in fingernails • inside the breast • on the thighs • Sneaking into hall before exam and attaching notes below desk • Developing “Mors code”, coughing, tapping desk etc. STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017

13. High tech examples of malpractice • Concealed ear-phones • Glasses (Small cameras installed) • Smart watches that look like digital watches • Using ultra violet pens and invisible ink pens • Hollowing out pens to write secret notes • Mobile phones • Calculators with memory functions used to hide answers STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017 13

14. Cheating Test Ads and sites in Internet STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017 STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017 14

15. Train invigilators or… STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017

16. Good invigilators are the solution • Dress smartly, wear the invigilator badge • Be aware of aware of emerging situations • Remain calm, vigilant, professional • Keep a written record of any relevant circumstances – who/what/when • An air of authority, yet relate with test-takers and staff • Maintain confidentiality • Provide a supportive atmosphere Prepare! - Test Invigilators never make assumptions STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017

17. Conclusion 1. Tests administration is of much more important than it is afforded in language testing literature 2. Practical matters of test administration are critical to test validity - raise validity questions pertaining to fairness, ethics, law and how different cultures view testing and test takers 3. Training Proctors and Invigilators is indispensable in order to ensure a standardized test administration STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017

18. STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017