M&M Case Presentations: Measuring Resident Competency

1. M&M Case Presentations: Measuring Resident Competency Mary C. Santos, MD, Manizheh Eghbali, MPH and Linnea S. Hauge, Ph.D.

2. Disclosures • Nothing to disclose

3. Background • ACGME requirements • Lack of tools available • Use of existing conferences

4. Development • ACGME definitions and toolbox • Faculty input • Medical education research group at University of Rochester • Surgical Education Research

6. Reliability • 3 faculty members • Individual education sessions • Implementation • Total scores • Cohen’s kappa 0.621 • Cronbach’s alpha 0.749

8. Design • Pre-test post-test design • M&M conference unchanged • Residents not informed about evaluations for first month of data collection • Resident education session • Data collection for another month • 2 separate groups of residents evaluated

9. Results • 35 observations pre-instruction, 32 post-instruction • No change in overall total score • Improvement in case presentation • Improvement in overall practice-based learning scores • No change SBP overall scores • Decreased discussion of involvement of other healthcare personnel

10. Results

11. Limitations • Small number of participants • May not be generalizable • 3-point scale used • Used groups of convenience

12. Discussion • M&M conferences can be evaluated with a tool to measure SBP and PBLI • In our institution, the tool is reliable and can be utilized as one of the instruments for measurement of SBP and PBLI • Minimal changes are noted in resident competency before and after a single educational intervention

13. Future Directions • Utilize in other conferences • Multi-institution study