
Summative Assessment Training Day Tidworth College 16 September 2005
What are Formative and Summative Assessment? • Formative assessment • continues throughout the GPR year • involves feedback to help you establish your needs • and to help you improve performance • Summative assessment • an end-stage assessment of competence
What is Summative Assessment for GP Training? • A test of minimal competence required for an independent practitioner in general medical practice • Looks at • knowledge • skills • attitudes • The vast majority of GPRs and Returners should have no difficulty in passing SA
Why have Summative Assessment? • Some GPRs aren’t ready for independent practice at the end of their GPR year • SA identifies those that need • extra support, or • more time
So, Summative Assessment is easy • BUT • it must be approached professionally
If you don’t pass SA… • You can’t work in General Practice • locum, • assistant, or • partner • money
What does SA involve? 1) M C Q 2) Written submission of practical work • usually an audit 3) Assessment of consulting skills • usually a video 4) Structured Trainer’s report
The National Office for Summative Assessment http//:www.nosa.org.uk
The MCQ • Positively marked • 170 True/False questions • 80 Extended Matching questions • 10 Single Best Answer questions
The MCQ • Not recommended until completed 3 months as GPR • but SHOs in hospital do pass! • Unlimited attempts permitted • 4 sittings per annum • Feb/May/Sept/Dec
The MCQ – true/false • Itching is commonly a presenting symptom in: • Atopic dermatitis T/F • Hodgkin’s disease T/F • Lichen planus T/F
The MCQ - Extended Matching Questions • A patient has difficulty swallowing. Which of the following investigations would help most with the diagnosis in the following clinical presentation: • A 19 year old male has been unwell for 10 days with a fever, sore throat, difficulty swallowing and general malaise • A, Barium Swallow B, Bronchoscopy • C, Endoscopy D, Manometry • E, Monospot F, Serum Iron • G, Thyroid Function Tests H, Throat swab • I, Video fluoroscopy
The MCQ – Single Best Answer Questions Meningitis • A Benzyl penicillin (IV) • B Erythromycin (IV) • C Oxygen via a face mask • D Phenoxymethylpenicillin (oral) • E Prednisolone (IV) • Which is the SINGLE best treatment from the above list of options? • A 4 year old boy is drowsy and shocked. He demonstrates neck stiffness and has a purpuric rash which doesn’t blanch on pressure. He has no known allergies.
The Structured Trainer’s Report • To be completed 1-2 months before the completion of training
The Structured Trainer’s Report • BUT should be read by Trainer and Registrar at the onset of the GPR year • AND reviewed regularly throughout the year
What is it? • Minimum standard of competence • To identify the incompetent or unready • 35 basic competencies • Must pass on all items
Collection of Evidence • Specific Clinical Skills (12) • Patient Care (12) • Making a Diagnosis • Patient Management • Clinical Judgement • Personal Skills (11) • Organisation Skills • Professional Values • Personal & Professional Growth
Formative use of Trainer’s report • Start using it now!
Formative use of Trainer’s report • Identify problems early • Share problems with Course Organisers and Associate Directors early • Develop a strategy to deal with areas of difficulty
The Written Submission • Completed Audit Cycle • or • National Project Marking Schedule (NPMS)
The Audit – a recipe for success • Must contain the following: • Title • Reason for choice • Criteria chosen • Reasons for choice of criteria • Standards set and why? • Preparation and planning
The Audit – a recipe for success • Must contain the following: • First data collection - include charts and graphs • Conclusions drawn from data • Change to be implemented • Second data collection – after change made • Conclusion and learning Points
K I S S EEP T IMPLE TUPID! The Audit – a recipe for success
The Audit – a recipe for success • Follow the recipe!
Audit Timetable • Month 1 Choose Topic • Month 2 First Data Collection • Month 3 Put in place changes • Month 4 Second Data Collection • Month 5 Completion + submit to Deanery
Audit checklist • Is the audit anonymous? • Layout • Double spaced • Pages single-sided and stapled • Pages numbered • GPR Number on each page • Word Count – not more than 3000 • Practice list size • Appropriate references • Audit declaration and consent form
Audit tips • Listen to your tutor today • KISS • Follow the recipe • Check out my audit website • www.mharris.eurobell.co.uk/contents.htm
MRCGP/SA Single Route • Submission of a single video for the MRCGP and Summative Assessment • Pass in MRCGP Video Module = • Pass in SA Consulting Skills component
Single route video • Common • video • logbook • summary sheet • consent form • Different standard - anticipate • 20%+ failure at MRCGP video • 5% failure at SA video
Single route video • Register with RCGP for video component of MRCGP – 7 February 2006 • Submit tapes to the Deanery by 28 April 2006 • MRCGP and SA Results issued separately: • SA by Deanery office on 30 June 2006 • MRCGP video by RCGP on 21 July 2006
Simulated Surgery • Examined in Leicester Deanery • Wednesday eveningsor Saturday afternoon • Must have permission from Director of Postgraduate GP Education before application is submitted
Your Deanery contact… • Vanessa Trickett • 01962 892729 • Vanessa.Trickett@sevwesdeanery.nhs.uk
Audit Submission 2 first level assessors PASS One or both REFER Result to GPR 2 second level assessors agree outcome REFER PASS Return to GPR to RESUBMIT
ResubmissionNew or revised audit 2 second level assessors REFER PASS 2 National level assessors FAIL