Piloting – a crucial part of test validation - PowerPoint PPT Presentation

bilc stanag 6001 testing workshop brno 2016 n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
Piloting – a crucial part of test validation PowerPoint Presentation
Download Presentation
Piloting – a crucial part of test validation

Loading in 2 Seconds...

play fullscreen
1 / 7
Piloting – a crucial part of test validation
0 Views
Download Presentation
larissar
Download Presentation

Piloting – a crucial part of test validation

- - - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

  1. BILC STANAG 6001 TestingWorkshop Brno, 2016 Piloting – a crucial part of test validation

  2. The role ofthelanguagetester is to collect evidence to support test useandinterpretationthat a largercommunity – thestakeholders (students, testers, teachersandsociety) – accept. (Fulcher, Davidson, 18, 2007) Pilotingfrom test validationpointofview

  3. Thelanguagetestercannotpoint to factsandclaim a test valid. There are manypossibleinterpretationsoffacts. Whathe or shehas to do is createan argument thatbestexplainsthefactsavailable. (Fulcher, Davidson, 18, 2007) What is evidence?

  4. Whichfactscanpilotinghelpcollectandwhichargumentscanpilotinghelpbuild?Whichfactscanpilotinghelpcollectandwhichargumentscanpilotinghelpbuild? Note: Wecannothave a valid test withoutreliableitems. How do wecreate a validity argument?

  5. 1 Our goal is toget a clearpictureaboutcandidates’ languageskills. 2 To get a clearpictureweneedreliable test items. 3 Impossibleto knowifitems are reliablewithoutpre-testing/piloting.

  6. Appropriatepopulation Administration Test format Statistical (quantitative) analyses Qualitativeanalysis Challenges…

  7. Ifyou don‘t knowwhereyou are going, anybuswill do.