Assessment in System-based Curriculum

1. Assessment in System-based Curriculum Dr Usman Mahboob Assistant Professor in Medical Education

2. First Year Modules • Foundation Module • Blood & Immunology • Musculo-skeletal and Locomotion • Cardiovascular • Respiratory

3. System-based Curriculum: How?

5. Year-1 Academic Colander

6. 01 - Foundation Module (6-weeks)

7. 02 – Blood & Immunology (5-weeks)

8. 03 – MSK & Locomotion (8-weeks)

9. 04 – CVS (5-weeks)

10. 05 – Respiratory (4-weeks)

11. Integrating Teaching of Behavious in Curriculum

12. Outcomes required by the PMDC

13. How to learn these skills? P – Professionalism, Patient safety & Communication Skills R– Research I– Identity formation M– Management & Leadership E – Ethics & Legal issues

14. Assessment in system-based curriculum

15. Assessment in System-based Curriculum • FM End of Module Exam • Block 1 exam (FM+ Blood) • Block 2 exam (MSK) • CVS End of Module Exam • Block 3 exam (CVS+ Resp.) • Pre-prof exam (Paper I, II, III) • Prof exam (University)

16. How to assess in System-based curriculum? • Assessment is based on blueprints • Students would pass the module/block • University theory paper – MCQ only • University Skills assessment – OSPE/OSCE only

17. Year 1 Professional Exam in System-based Curriculum

18. Sample Blueprint: Paper A (FM+ Blood) * Distribution of MCQs are based on a ratio of 1.7:1 (158:93) between 2 modules

19. Sample Blueprint: Paper B (MSK)

20. Sample Blueprint: Paper C (CVS+ Resp.) CVS module (total 109 hours) Respiratory module total 65 hours) *total MCQs are distributed with a ratio of 1.7:1 (109:65) ! example=(30/120) x 50 (where 30 is the total no. of MCQ for gross anatomy in individual Respiratory module out of 120 MCQs and 50 is the total MCQs required for block assessment according to the ratio of 1.7:1)

21. OSPE • Minimum 18 stations (excluding pilot and rest stations) for each batch. • Mix of static and interactive stations. • Time: Minimum 3-6 minutes, including 1 minute for movement between the stations and reading the instructions. • Faculty up to demonstrator/ SR level to be involved. • For every block exam, there should be at least three external examiners for the major subjects • One of the external examiner - Nominated as coordinator

22. Example: OSPE CircuitMSK & Locomotion Static Shoulder Joint model Ana Internal Viva Static Histology slide Enter Phy Internal Viva Static Walking mechanism Ana External Viva Static Action potential Phy External Viva Static ATP production Bio External Viva Static G6PD deficiency Bio Internal Viva Exit

23. OSPE Circuit Dr Usman Mahboob This Photo by Unknown Author is licensed under CC BY-SA

24. Example of Paper A

25. 7 5 9 3 1 25 OSPE Circuit Paper A (FM+ Blood & Immunology) 11 23 13 19 17 21 15

26. Plan 1 (Single Circuit – 25 students) Total Circuit Time: 25 * 5 = 125 minutes (2 hours and 5 minutes) • Circuit 1 (9 – 11:05 AM) • Break 1 (11:05 – 11:30 AM) • Circuit 2 (11:30 AM – 1:35 PM) • Break 2 (1:35 – 2:00 PM) • Circuit 3 (2:00 – 4:05 PM) • Break 3 (4:05 – 4:30 PM) • Circuit 4 (4:30 – 6:35 PM)

27. Plan 2 (Parallel Circuits – 50 students) Boys Common Room Girls Common Room • Circuit 1 (9 – 11:05 AM) Group A & B • Break 1 (11:05 – 12:00 PM) • Circuit 2 (12:00 – 2:05 PM) Group C & B

28. Works cited

29. Thank you Dr Usman Mahboob MBBS, MPH, FHEA (UK), PhD (UK), Fellow FAIMER (USA) Director Medical Education Khyber Medical University usman.mahboob@kmu.edu.pk