What are we to do
This presentation is the property of its rightful owner.
Sponsored Links
1 / 23

What are we to do? PowerPoint PPT Presentation


  • 34 Views
  • Uploaded on
  • Presentation posted in: General

What are we to do?. Jim Crossley for Maastricht 2012. Outline. A crisis in WPBA A brief history in lenses Construct-aligned scales Some implications. Outline. A crisis in WPBA A brief history in lenses Construct-aligned scales Some implications. Crisis.

Download Presentation

What are we to do?

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


What are we to do

What are we to do?

Jim Crossley

for Maastricht 2012


Outline

Outline

  • A crisis in WPBA

  • A brief history in lenses

  • Construct-aligned scales

  • Some implications


Outline1

Outline

  • A crisis in WPBA

  • A brief history in lenses

  • Construct-aligned scales

  • Some implications


Crisis

Crisis

UK Academy of Medical Royal Colleges 2010

“The profession has rightly lost all confidence in Workplace Based Assessment”


Outline2

Outline

  • A crisis in WPBA

  • A brief history in lenses

  • Construct-aligned scales

  • Some implications


Getting a clear picture

Getting a clear picture


First lens constructs

First lens - constructs

?


Getting a clear picture1

Getting a clear picture


Getting a clear picture2

Getting a clear picture


Sampling

Test Sample

Test Sample

Sampling

Domain of Interest


Second lens sampling

Second lens - sampling

?


Getting a clear picture3

Getting a clear picture


Outline3

Outline

  • A crisis in WPBA

  • A brief history in lenses

  • Construct-aligned scales

  • Some implications


Surgical skills study

3 instruments

1635 assessments

437 cases

15 index procedures

5 specialities

85 surgical trainees

155 judges

Modelled reliability with 3 cases & 2 observers

PBA, G=0.81

NOTTS, G=0.59

OSATS, G=0.65

Surgical skills study


Pba response scale

Level 1 Unable to perform the procedure, or part observed, under supervision

Level 2 Able to perform the procedure, or part observed, under supervision

Level 3 Able to perform the procedure with minimum supervision (needed occasional help)

Level 4 Competent to perform the procedure unsupervised (could deal with complications that arose)

Very Poor

Poor

Good

Very good

PBA response scale


It generalises

It generalises


Getting a clear picture4

Getting a clear picture


Third lens judge alignment

Third lens – judge alignment

?


Outline4

Outline

  • A crisis in WPBA

  • A brief history in lenses

  • Construct-aligned scales

  • Some implications


Understanding development

Understanding development

Please join in!


Judgement and obscurity

judgement and obscurity

Now we see as through a glass darkly; then we shall see face to face. Now I know in part; then I shall know fully, even as I am fully known.

1 Corinthians 13:12


  • Login