Admissions Workshop PCAT: Proposed Changes for the Future

2. Admissions WorkshopPCAT: Proposed Changes for the Future Andrea L. Wall, BSPharm., R.Ph. Paul W. Jungnickel, Ph.D., R.Ph. Renee M. DeHart, Pharm.D.

3. AACP Governance Admissions

4. Admissions Landscape • Pre-Pharm Curriculum • Holistic Admissions • Other Health Professions

5. AACP Interim meeting February 2013 Special meeting of the PCAT Advisory Committee included members of PCAT Advisory Committee, PharmCAS Advisory Panel, Peggy Piascik, President-elect AACP, Kathy Kelley, Marilyn Speedie, Pearson staff

6. Argus Commission 2012 Recommendation of the Argus Commission 2012 report Examination of the Role of Pre-Pharmacy Education in Cultivating “Habits of the Mind” in Pharmacists Recommendation : use of assessment tools for affective domain- critical thinking, problem solving, inquisitiveness, professionalism Cultivating ‘Habits of Mind’ in the Scholarly Pharmacy Clinician: Report of the 2011-12 Argus Commission AJPE 2012:76(6)

7. Examples of Assessment tools • Personal Potential Index (PPI) • California Critical Thinking Skills Test • Situational Judgment Testing • Professionalism Assessment Tool Cross-Validation of an Instrument for Measuring Professionalism Behaviors, Kelley et al AJPE 2011 75(9)

8. PCAT Can PCAT be modified to assess the affective domain?

9. Moving Forward: Proposed Revisions to the PCAT • Present current PCAT model and proposals for 2 additional years • Highlight changes under consideration • Greater critical thinking and reasoning • Items based on more extensive reading • Decreased test duration • Solicit discussion and feedback

10. Current PCAT Blueprint

11. Options for 2014-2015 • Goal is to move towards items that require higher order thinking and reasoning • Field-test items for Biology, Chemistry, and with more extensive passages (4 items per passage) • Field-test Quantitative items with problem or scenario stated in stem text • Field-test Reading Comprehension items with humanities and Social Science content • Remove Verbal Ability – need your feedback • Would allow more time to test new item types in Biology, Chemistry and Quantitative sections

12. Proposed PCAT Test Blueprint for 2014–15: Field-Testing New Item Types

13. Looking Forward to 2015-2016 • Goal is to increase testing of critical thinking • Biological and Chemical processes: 40-50 percent of items with passages • Critical Reading: 40-60 percent of items from humanities and social sciences • Quantitative Reasoning • 40-50 percent of items with stem text set-up • Less emphasis on calculus and pre-calculus

14. Proposed PCAT Test Blueprint for 2015–16: Introducing New Operational Items

15. Situational Judgment Tests (SJTs) • Test which presents realistic, hypothetical scenarios • SJTs not simply “off the shelf” tests, but are designed to address specific role requirements • Have been used in functions such as personnel selection

16. Desired SJT Assessments Presented to Pearson • Empathy and altruism • Ethical reasoning, integrity • Interpersonal skills • Team player • Self awareness • Problem solving, creativity

17. Sample SJT (Available at: http://www.assessmentday.co.uk/situational-judgement-test/SJT-Questions.pdf)

18. SJT: Current Status • Pearson’s Talent Team has been further researching SJTs this spring • Update to PCAT Advisory Committee due at its meeting here in Chicago • AAMC also looking at SJTs this summer

19. Questions for Today’s Audience

20. Future Follow-up • A call for feedback will be sent to Student Services SIG: due August 1st • Webinar(s) being planned: Tuesday, 9/17/13 from 2 - 3 p.m. CT Wednesday, 9/18/13 from 10 -11 a.m. CT. 

21. Discussion and Questions