Summative Assessment Training Day

1. Summative Assessment Training Day Tidworth College 16 September 2005

2. What are Formative and Summative Assessment? • Formative assessment • continues throughout the GPR year • involves feedback to help you establish your needs • and to help you improve performance • Summative assessment • an end-stage assessment of competence

3. What is Summative Assessment for GP Training? • A test of minimal competence required for an independent practitioner in general medical practice • Looks at • knowledge • skills • attitudes • The vast majority of GPRs and Returners should have no difficulty in passing SA

4. Why have Summative Assessment? • Some GPRs aren’t ready for independent practice at the end of their GPR year • SA identifies those that need • extra support, or • more time

5. So, Summative Assessment is easy • BUT • it must be approached professionally

6. If you don’t pass SA… • You can’t work in General Practice • locum, • assistant, or • partner • money

7. What does SA involve? 1) M C Q 2) Written submission of practical work • usually an audit 3) Assessment of consulting skills • usually a video 4) Structured Trainer’s report

8. The National Office for Summative Assessment http//:www.nosa.org.uk

9. The MCQ • Positively marked • 170 True/False questions • 80 Extended Matching questions • 10 Single Best Answer questions

10. The MCQ • Not recommended until completed 3 months as GPR • but SHOs in hospital do pass! • Unlimited attempts permitted • 4 sittings per annum • Feb/May/Sept/Dec

11. The MCQ – true/false • Itching is commonly a presenting symptom in: • Atopic dermatitis T/F • Hodgkin’s disease T/F • Lichen planus T/F

12. The MCQ - Extended Matching Questions • A patient has difficulty swallowing. Which of the following investigations would help most with the diagnosis in the following clinical presentation: • A 19 year old male has been unwell for 10 days with a fever, sore throat, difficulty swallowing and general malaise • A, Barium Swallow B, Bronchoscopy • C, Endoscopy D, Manometry • E, Monospot F, Serum Iron • G, Thyroid Function Tests H, Throat swab • I, Video fluoroscopy

13. The MCQ – Single Best Answer Questions Meningitis • A Benzyl penicillin (IV) • B Erythromycin (IV) • C Oxygen via a face mask • D Phenoxymethylpenicillin (oral) • E Prednisolone (IV) • Which is the SINGLE best treatment from the above list of options? • A 4 year old boy is drowsy and shocked. He demonstrates neck stiffness and has a purpuric rash which doesn’t blanch on pressure. He has no known allergies.

14. The Structured Trainer’s Report

15. The Structured Trainer’s Report • To be completed 1-2 months before the completion of training

16. The Structured Trainer’s Report • BUT should be read by Trainer and Registrar at the onset of the GPR year • AND reviewed regularly throughout the year

17. What is it? • Minimum standard of competence • To identify the incompetent or unready • 35 basic competencies • Must pass on all items

18. Collection of Evidence • Specific Clinical Skills (12) • Patient Care (12) • Making a Diagnosis • Patient Management • Clinical Judgement • Personal Skills (11) • Organisation Skills • Professional Values • Personal & Professional Growth

19. Formative use of Trainer’s report • Start using it now!

20. Formative use of Trainer’s report • Identify problems early • Share problems with Course Organisers and Associate Directors early • Develop a strategy to deal with areas of difficulty

21. The Written Submission

22. The Written Submission • Completed Audit Cycle • or • National Project Marking Schedule (NPMS)

23. The Audit – a recipe for success • Must contain the following: • Title • Reason for choice • Criteria chosen • Reasons for choice of criteria • Standards set and why? • Preparation and planning

24. The Audit – a recipe for success • Must contain the following: • First data collection - include charts and graphs • Conclusions drawn from data • Change to be implemented • Second data collection – after change made • Conclusion and learning Points

25. K I S S EEP T IMPLE TUPID! The Audit – a recipe for success

26. The Audit – a recipe for success • Follow the recipe!

27. Audit Timetable • Month 1 Choose Topic • Month 2 First Data Collection • Month 3 Put in place changes • Month 4 Second Data Collection • Month 5 Completion + submit to Deanery

28. Audit checklist • Is the audit anonymous? • Layout • Double spaced • Pages single-sided and stapled • Pages numbered • GPR Number on each page • Word Count – not more than 3000 • Practice list size • Appropriate references • Audit declaration and consent form

29. Audit tips • Listen to your tutor today • KISS • Follow the recipe • Check out my audit website • www.mharris.eurobell.co.uk/contents.htm

30. MRCGP/SA Single Route • Submission of a single video for the MRCGP and Summative Assessment • Pass in MRCGP Video Module = • Pass in SA Consulting Skills component

31. Single route video • Common • video • logbook • summary sheet • consent form • Different standard - anticipate • 20%+ failure at MRCGP video • 5% failure at SA video

32. Single route video • Register with RCGP for video component of MRCGP – 7 February 2006 • Submit tapes to the Deanery by 28 April 2006 • MRCGP and SA Results issued separately: • SA by Deanery office on 30 June 2006 • MRCGP video by RCGP on 21 July 2006

33. Simulated Surgery • Examined in Leicester Deanery • Wednesday eveningsor Saturday afternoon • Must have permission from Director of Postgraduate GP Education before application is submitted

34. Your Deanery contact… • Vanessa Trickett • 01962 892729 • Vanessa.Trickett@sevwesdeanery.nhs.uk

35. Audit Submission 2 first level assessors PASS One or both REFER Result to GPR 2 second level assessors agree outcome REFER PASS Return to GPR to RESUBMIT

36. ResubmissionNew or revised audit 2 second level assessors REFER PASS 2 National level assessors FAIL