ARCP unveiled!

1. ARCP unveiled! Dr Alison Bonavia Associate Director for Assessment

2. ePortfolio • Archive of learning – logs and assessments • More importantly a vehicle for assessing progress to developing competence • Facilitates the identification of learning needs • Opportunity for formative feedback • Learning log captures “naturally occurring evidence” and spread of evidence

3. Learning Log • Regular sharing – not clustered! • Reflect when things could have been better • Reflect on complaints/SEAs/critical events • Variety of learning events • Look for curriculum gaps • Anonymise staff/patient data • Respond to feedback comments

4. Validation of LLE • ‘Confirms LLE provides appropriate evidence of the learning described by the trainee in the tagged area of the competency framework’ • NOT a judgement on performance/competence • Both ES and CS are encouraged to validate

5. PDP • “Personal, reflective, living document” • Trainees set own learning objectives • Needs identified through reflection on clinical practice • SMART • Ensure actively used

6. Quality Improvement Activities • Manage a quality improvement project • Be able to conduct a clinical audit – demonstrate understanding of audit • Contribute to adverse event recognition – SEAs, feedback to colleagues, team based

7. Educational Review • Trainee responsibility – arrange in time! • Preparation takes longer than you expect! • ESR every 6 months • Compulsory annual ARCP – Gold Guide • Reminder email if ARCP scheduled • Your responsibility to ensure evidence readily accessible by ARCP panel – ST3 Final ARCP checklist

8. Trainee Self Ratings • Rate progression across the 13 areas of competence • Tag up to 3 pieces of evidence to justify your rating - variety • Explain why the evidence justifies your rating – “narrative” • Insight and reflection expected in the self-rating • Use the “actions” section to inform future development

9. ES ratings • If trainee self rating comprehensive then ES may just add comment “read and agree” • If necessary will add up to 3 extra evidence • Own narrative and evidence if borderline or unsatisfactory progress

10. ARCP • What is the ARCP? • ARCP purpose? • When is an ARCP panel needed? • Who makes up the ARCP Panel? • Do all trainees attend? • Main resource is the Gold Guide

11. Purpose of an ARCP Panel • Gold Guide • To consider and approve adequacy of evidence, including ESR • To consider time out of training (TOOT) and determine whether extended time is required • To make a judgement about the trainee’s progress and whether suitable to progress to the next level/CCT • Provide advice to the Responsible Officer about revalidation • To give feedback to Educational and Clinical Supervisors on their performance

12. ARCP Panel Process • Chair introduction and scene setting • TPD presentation of paper if needed • Brief review of ePortfolio • Panel discussion – preparation notes • Determine “outcome” • Notify the trainee and TPD • ES feedback

13. What is the evidence telling us? • Has a problem been identified? • Has the trainee been supported in addressing the difficulties? • Is there enough evidence to suggest this trainee is meeting minimum standards? • Treat all trainees equally • Make judgments based on facts and evidence • Make patient safety our first concern

14. Where we look for evidence • Ratings and linked evidence • ES summary boxes • MSF & PSQ • Assessments – dip in • CSR • Learning logs • PDP • Educators Notes

15. Educators Notes • Rich source of information • Look for evidence of problems/ concerns • Look for reminders to engage • Look for praise and positive feedback • Training Programme reports

16. Ratings & linked evidence • Breadth and depth of evidence linked • Match between ES and trainee – insights? • Differences justified? • Judgements justified? • Overall assessment justified? • Suggested actions helpful to trainee?

17. WPBA • Dip in to COTs, CBDs etc • Are the ratings congruent with the Competence ratings? • Who has done them? • Trainer/ Clinical supervisor/ OOH CS/ Peers • CSR • Look at any since last ARCP • Sometimes helpful • Essential for assessing short posts

18. MSF and PSQ • MSF Useful marker • Look at scores and comments – REFLECTION • PSQ less useful • Low scores more useful

19. ES Summary Boxes • PDP – SMART? Used? • Quality of evidence • Summary and recommendations • Often useful commentary from ES

20. Progress to certification • AKT and CSA results with dates booked • Quality Improvement, audit, SEA, E&D • Valid AED/CPR certificate • Must be ticked at final ESR/ARCP • CPR lasts 3 years for trainees • OOH requirements met - Must be ticked for final ESR/ARCP • Safeguarding requirements met • Must be ticked for final ESR/ARCP

21. Outcomes and consequences Consequences: 1 – carry on to next ST year, or within year if LTFT or out of sync 2 - likely to have another panel in 3-6 months to check progress against written objectives 3 – Extension awarded with objectives and review at or before end of extension. Appeal process available. 4 – Removal of NTN. Appeal process available and careers advice. Potential for some to use CEGPR route to becoming a GP. 5 – Trainee must account to panel within 5 days stating how they will meet the deficit in evidence. Panel consider evidence (usually virtually) once it has been provided and issue new outcome. 6 – Can apply for CCT via RCGP and GMC 8 – Need to make sure that all training reviewed at subsequent ARCP panel once the trainee is back at work. This needs to be recorded on the ARCP panel form. Excellent table on p 70 of Gold Guide Trainees can appeal against outcomes 2,3 & 4

22. On the horizon…… • PDPs – trainees to draft PDP prior to ESR meeting • “Requirement for OOH” tick box to be changed to “meeting competence in OOH” • Competence areas will change to Capabilities (GMC) • LTC learning and management documented • Word descriptors being re-written • Minimum 1 audio COT in ST3 • Multiple assessors of COTs

23. On the horizon…. • Leadership MSF – leadership is an important part of role of GP 2nd half ST3 • New CSR – links to competencies – with text • CS must have completed at least one assessment • Improved PSQ • SEAs will change to “case review” • ?Less assessments in hospital and more in GP • More advanced areas assessed in ST3