Innovative Assessment of Trainee Competencies

1. Innovative Assessment of Trainee Competencies Wayne Siegel, Ph.D., ABPP Cathi Grus, Ph.D Elizabeth Klonoff, Ph.D., ABPP Robert Goldberg, Ph.D., ABPP

2. Objectives Explain the historical and often limited methods for assessing trainee competence. Describe considerations in developing valid methods to assess competence and its importance to the training of psychologists and the profession overall. List the benefits and limitations of using standardized patients to assess competence at the doctoral program level. Discuss the benefits and limitations of an “oral competency” method of assessing competence at the internship level.

3. Outline • Introduction • Wayne Siegel, Ph.D., ABPP • 20,000 Overview • CathiGrus, Ph.D • Using Standardized Patients • Elizabeth Klonoff, Ph.D., ABPP • An “Oral Competency” approach • Robert Goldberg, Ph.D., ABPP

4. Where are we at now? • Doc Programs • Knowledge • Grades, projects, dissertation, comps • Clinical skills • Practicum – supervisor ratings • Internship and postdoc • Supervisor subjective perception of trainee performance. • Weak behavioral anchors often tied to level of independence

5. Where are we at now? • No teeth • Lack of uniform agreed upon competencies at all levels including licensure • Subjective ratings have almost non-existent reliability and validity • How do we know who is competent? • We know it when we see it (or not)?

6. Where are we at now? • Consequences • Inefficient and ineffective tool to provide feedback for trainee development • No clear ability to gate keep at internship and licensure level • How “incompetent” does someone have to be to NOT make it through the gate? • Contributes to the Match imbalance • Poor protection of the public • Overall impact on the profession of psychology