180 likes | 300 Views
This paper by Emyr Wyn Benbow explores the concept of progress testing in medical education. It examines the role of assessment in driving learning and highlights the distinction between assessment and curriculum development. It critiques traditional assessment methods and advocates for longitudinal testing of knowledge retention over time. The study presents the Maastricht model of progress testing, which includes frequent assessments across the curriculum and emphasizes the importance of formative and summative evaluations. The challenges and considerations in implementing effective progress testing are also discussed. ###
E N D
Progress Testing – Some Principles Emyr Wyn Benbow University of Manchester
So does assessment drive learning? • you bet! • assessment driving the curriculum? • not the same thing at all • but a major danger • “a primary function of testing is to communicate what you view as important” Case and Swanson (2001)
So does assessment drive appropriate learning? • not on your life! • bad assessment drives awful learning • can we change that? • yes, but it’s tough, tough, tough
So what’s progress testing? - don’t we do that already?
So what’s progress testing? - don’t we do that already? • no, we don’t, at least not all of us • isn’t it the same as continuous assessment? • no, it isn’t
So what’s progress testing? - longitudinal (or vertical) testing of knowledge acquisition • assessing the acquisition and retention of knowledge over time • frequent testing overcomes “learn and forget”
So what’s progress testing? - test the entire curriculum, not just bits of it • formative and summative • typically norm-referenced, but it doesn’t have to be
Maastricht progress testing • 200 mc-questions (incl question mark option) • 17 Categories (ICD) • 19 Disciplines • Correct minus incorrect scoring • Norm referenced standards per yeargroup • 4 times/year at fixed points (September, December, March, May) • All medical students simultaneously (year 1-6) Ilske Timmermans, Maastricht
Maastricht progress testing Ilske, Maastricht
Maastricht progress testing Ilske, Maastricht
Testing progress - are the learners learning enough? - are they retaining enough? • are they learning fast enough? • are they learning as much as those in other schools?
Testing progress • true/false • MCQs or EMQs • some have used SAQs • tests of knowledge, not competences • test early, test often • test the intended curriculum outcomes
Testing frequency • four times a year • Maastricht, Peninsula • three times a year • McMaster • twice a year • Manchester
Hierarchy of Skills: Miller’s Pyramid Workplace Based Assessment Portfolios DOES SHOWS HOW OSCE Extended matching / CRQ KNOWS HOW KNOWS MCQs true/false
Things to think about • standard setting • norm referencing v. criterion referencing • negative marking or not • cumulative outcomes • grades or scores • resources, resources, resources
The End - but this is just the end of the beginning!