1 / 7

Piloting – a crucial part of test validation

Learn about the crucial role of piloting in test validation and how language testers collect evidence to support test use and interpretation. Explore the importance of reliable test items and creating validity arguments.

larissar
Download Presentation

Piloting – a crucial part of test validation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. BILC STANAG 6001 TestingWorkshop Brno, 2016 Piloting – a crucial part of test validation

  2. The role ofthelanguagetester is to collect evidence to support test useandinterpretationthat a largercommunity – thestakeholders (students, testers, teachersandsociety) – accept. (Fulcher, Davidson, 18, 2007) Pilotingfrom test validationpointofview

  3. Thelanguagetestercannotpoint to factsandclaim a test valid. There are manypossibleinterpretationsoffacts. Whathe or shehas to do is createan argument thatbestexplainsthefactsavailable. (Fulcher, Davidson, 18, 2007) What is evidence?

  4. Whichfactscanpilotinghelpcollectandwhichargumentscanpilotinghelpbuild?Whichfactscanpilotinghelpcollectandwhichargumentscanpilotinghelpbuild? Note: Wecannothave a valid test withoutreliableitems. How do wecreate a validity argument?

  5. 1 Our goal is toget a clearpictureaboutcandidates’ languageskills. 2 To get a clearpictureweneedreliable test items. 3 Impossibleto knowifitems are reliablewithoutpre-testing/piloting.

  6. Appropriatepopulation Administration Test format Statistical (quantitative) analyses Qualitativeanalysis Challenges…

  7. Ifyou don‘t knowwhereyou are going, anybuswill do.

More Related