1 / 14

PILOTING CROATIAN EXPERIENCE Tamara Kramarić Maras

PILOTING CROATIAN EXPERIENCE Tamara Kramarić Maras. However well designed an examination may be, and however carefully it has been edited, it is not possible to know how it will work until it has been tried out on students.

cameron-rush
Download Presentation

PILOTING CROATIAN EXPERIENCE Tamara Kramarić Maras

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. PILOTINGCROATIAN EXPERIENCETamara Kramarić Maras

  2. However well designed an examination may be, and however carefully it has been edited, it is not possible to know how it will work until it has been tried out on students. Alderson, Clapham and Wall.1995.Language Test Construction and Evaluation, Cambridge:University Press

  3. CHALLENGES • establishing a system • number of pilot tests and items • piloting tests or sets of items • pre-testing before piloting • finding the suitable population (size, time) • administering the test • interpreting the statistics • establishing the control group

  4. PLANNING • how many pilot tests a year? • where? • population size and level? • the most appropriate dates? • budget?

  5. 2 pilot tests a year • Slovenia , BiH • May/November • 35-60, L1+, L2, L3 • bilateral activity, host country responsible for costs of accomodation/food • a detailed rationale

  6. PILOT TEST CONSTRUCTION AND ADMINISTRATION • what should the pilot test look like? • more items than in the real test? • pre-piloting before the pilot? • test administration • student preparation and motivation

  7. resembling the real test as much as possible (number of tasks/items, layout, task types, rubrics, time) • pre-piloting on available population in FLS • administering the test ourselves + standardisation session • students need to understand the mutual benefits

  8. INTERPRETATION OF STATISTICS • satisfactory values of FV/DI? • ALCPT as a factor • anchor items

  9. L2 FV 70% - 90% DI 0,2-0,4 • L3 FV 40% - 60% DI 0,5 -1 (bi-level tests of reading/listening) (population of 1/3 L3, 2/3 L1+, L2)

  10. CONTROL GROUP • not enough candidates in FLS for L2 /L3 piloting in Croatia • who else could be involved in piloting?

  11. establishing a control group • volunteers (L2/L3 or ALCPT 80+), cadets • importance of motivation • updating and extending the control group

  12. BENEFITS OF PILOTING • main validation process • standardisation through moderation • standardisation sessions (oral and written tests) • new ideas • backwash on teaching/learning

  13. ????

More Related