The Multiple Mini-Interview CAAHP 2012 Ellen Hughes Denise MacIver

1. The Multiple Mini-Interview CAAHP 2012 Ellen Hughes Denise MacIver

2. MMI Presentation Outline • Multiple Mini Interviews (MMIs): • Why? What? Who? How? • Interactive Sessions • Training • Rotations (35 minutes) • Debriefing • MMIs by Distance – Can it work? • Q & A

3. Why? Benefits of the MMI The MMI is an innovative, feasible, acceptable, and reliable interview technique that is: • Assess different non-cognitiveattributes • Reliable and valid • Less biased/more defensible than traditional panel interview • Designed to reflect the values of the profession • Multiple first impressions • Ability to interview a large number of applicants in less time with less resources

4. TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. MMIs: Multiple First Impressions • MMI • Non-cognitive qualities of an individual • Formats: Discussion, Collaborative or Acting. • Applicant reads a question ( 2min), enters a room, answers the question (5-10 min), leaves room and repeats at next station. • 6 – 10 questions

5. What? Assessing Non-Cognitive Abilities • The MMI assesses Non-Cognitive abilities such as: • Teamwork • Responsibility • Ethical & moral judgment • Communication skills • Management skills • Problem solving • Self awareness • Conflict resolution • (Career Investigation)

6. MMIs: Who?Interviewers and Candidates Candidate Collecting Room Interviewers are trained shortly before the interview day. On Interview Day: Candidatesare gathered in one room for orientation/training Interviewers receive their packages, see questions for the 1st time and are shown their rooms. A C D B I I I I I I I I H E F G

7. MMIs: How? Interviewers and Candidates Candidate’s First Scenario Question 2 minutes outside the room reading the question; 5 minutes in the room. 8 Station Circuit I I I I I I I I A B C D E F G H A buzzer sounds at 2 minutes (reading question), 4 minutes & 30 seconds (wrap up), then again at 5 minutes (leave room, move to next station)

8. Rotation of Candidates Candidates Next Scenario Questions Candidates continue to rotate through the rooms (stations). Candidates have 2 minutes to read the questions outside the room and 5 minutes to answer the questions in the rooms. Interviewers do not move. Candidates move. A buzzer sounds at 2m, 4m30s, 5m each time I I I I I I I I G H D E F B C A

9. Example Rotation for 1 Interviewer (1 station) • An example of what it will look like for one interviewer… • 8 interviews/hr • 48 interviews per 6 hr-day • With 8 interviewers how many interviews per day?

10. TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. CAAHP MMIs: 3-Station Circuit • MMI • Non-cognitive qualities (decision making, ethical judgment, inter-professional skills). • “Discussion” Format – 1 interviewer to 1 candidate • Candidate reads a question (1 min), enters a room, answers the question (4 min), leaves room and repeats at next station. • 3 questions

11. CAAHP 2012 Simulated MMIs:3 Station Circuits – 5 minutes each 5 minutes to Switch Roles

12. Training: Role of the Candidate • Prior notice of MMI style of interview • Orientation/Training on Day of Interviews • Review your schedule • Move when the bell rings • You have 1 minute to read the question (bell will ring after 1 minute) • You can make notes while you read the question • You have 4 minutes to answer the question (warning bell will ring after 3m, 30 secs (wrap up), then at 4 minutes – time to move to next station)

13. Training: Role of the Interviewer • Confirm that the correct candidate enters the room – they will give you a label with their name to put on your score sheet • Confirm no conflict of interest • Ask the candidate if they have read the question • Ensure a fair but rigorous opportunity for the applicant to meet the criteria for the station

14. Role of the Interviewer…cont. • Remain objective and do not provide feedback or in any way divulge an opinion of the performance of an applicant • Do not read the question or clarify the question for the applicant – the question is posted for the candidate • Provide a considered and justifiable score at the station using the entire scale of ratings for each group of candidates

15. Scoring • For the first couple of candidates, you may wish to make notes and score them on a separate piece of paper. Once you get a feeling for the question, you can transfer the scores to the score sheets. • You CAN change scores you’ve given candidates who have come and gone from your room.

16. Score Sheet • Record only negative comments – keep it professional (forms are FOIP-able) • Use the entire grading scale! • No half marks – only whole numbers • Use check mark to score (not x’s, lines, or circles)

17. Interviewer Package Items included: • Your Scenario question • A supporting document to assist you with the question • Score sheets • Candidate Rotation Schedule • List of Candidates • Pencil & eraser, notepaper

18. CAAHP 2012 Simulated MMIs:3 Station Circuits – 5 minutes each 5 minutes to Switch Roles

19. TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. Debriefing • Experiences as a Candidate? • Experiences as an Interviewer? • Other?

20. Validity of videoconferencing for entrance interviews (not yet published) Dr Randy W. Dreger Heather Gray, BSc, Chair-Diagnostic Laboratory & Medical Transcription Joy Lutz, CLXT, Instructor-Combined Laboratory & X-Ray Technology. Denise MacIver, M.Ed., Associate Dean-SHS Ellen Hughes, M.Ed., Dean-SHS Scott Paradis, CPT, Research Assistant-SHS Technical Support Troy Gregoire, School of Information Communications and Engineering

21. TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. Validity of videoconferencing for entrance interviews • Background • Interviewing applicants has been and remains an important part of the selection process. • Typically done in a face to face environment • Not always feasible • New technology may ameliorate this issue

22. TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. Validity of videoconferencing for entrance interviews • Problem • ProFitHR a private company who specializes in the interview process were looking to determine if their product the MMI could be performed via Skype and produce valid results.

23. TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. Validity of videoconferencing for entrance interviews • Research Design • 23 NAIT students (no MMI experience) • Cross over design • 10 stations Day 1 Day 2

24. TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. Validity of videoconferencing for entrance interviews • Results • F2F - 6.2 ±1.5. • Skype - 6.1 ±1.8 • no significant difference between the scores

25. TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. Validity of videoconferencing for entrance interviews • Results • • Compared to the F2F condition the applicant ranking on Skype: • 2 no change • 12 did better • 9 did worse • suggesting no systematic difference • A secondary question was to determine if there was a day to day or learning effect. The scores for day 1 were 5.9 out of 10 and day 2 was 5.8 out of 10, no significant difference

26. TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. Validity of videoconferencing for entrance interviews • Results • • Seventy percent of the applicants preferred the F2F method while 17% preferred Skype and 13% liked either method equally. • The interviewers also preferred the F2F method (70%) with 30% choosing either. • When asked about performing the MMI in the future 52% of applicants would prefer F2F, 13% Skype and 35% would use either. • Interviewers’ responses were 30% F2F, 10% Skype and 60% either.

27. TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. Validity of videoconferencing for entrance interviews • Future Projects • Replicate the study with a large and more diverse sample. • Replicate this study in a “non-laboratory” setting.

28. Thank You! Questions?