BILC STANAG 6001 TestingWorkshop Brno, 2016 Piloting – a crucial part of test validation
The role ofthelanguagetester is to collect evidence to support test useandinterpretationthat a largercommunity – thestakeholders (students, testers, teachersandsociety) – accept. (Fulcher, Davidson, 18, 2007) Pilotingfrom test validationpointofview
Thelanguagetestercannotpoint to factsandclaim a test valid. There are manypossibleinterpretationsoffacts. Whathe or shehas to do is createan argument thatbestexplainsthefactsavailable. (Fulcher, Davidson, 18, 2007) What is evidence?
Whichfactscanpilotinghelpcollectandwhichargumentscanpilotinghelpbuild?Whichfactscanpilotinghelpcollectandwhichargumentscanpilotinghelpbuild? Note: Wecannothave a valid test withoutreliableitems. How do wecreate a validity argument?
1 Our goal is toget a clearpictureaboutcandidates’ languageskills. 2 To get a clearpictureweneedreliable test items. 3 Impossibleto knowifitems are reliablewithoutpre-testing/piloting.
Appropriatepopulation Administration Test format Statistical (quantitative) analyses Qualitativeanalysis Challenges…