Assessing situational judgment with a structured interview construct validity and adverse impact
This presentation is the property of its rightful owner.
Sponsored Links
1 / 7

Assessing Situational Judgment with a Structured Interview: Construct Validity and Adverse Impact PowerPoint PPT Presentation


  • 44 Views
  • Uploaded on
  • Presentation posted in: General

Assessing Situational Judgment with a Structured Interview: Construct Validity and Adverse Impact. Frederick P. Morgeson Talya N. Bauer Donald M. Truxillo Michael A. Campion. Slides are available at: http://www.msu.edu/~morgeson/.

Download Presentation

Assessing Situational Judgment with a Structured Interview: Construct Validity and Adverse Impact

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Assessing situational judgment with a structured interview construct validity and adverse impact

Assessing Situational Judgment with a Structured Interview: Construct Validity and Adverse Impact

Frederick P. Morgeson

Talya N. Bauer

Donald M. Truxillo

Michael A. Campion

Slides are available at: http://www.msu.edu/~morgeson/

In F. L. Oswald (Chairperson), Advances and Construct Validity Issues in Situational Judgment Tests. Symposium conducted at the 18th Annual Conference of the Society for Industrial and Organizational Psychology, Orlando, FL.


Use of situational judgment tests

Use of Situational Judgment Tests

  • Become much more prominent

  • Typical format

    • Paper & Pencil

    • Multiple choice Q&A

    • Different ways to score

  • Good criterion, unknown construct validity

    • McDaniel et al. (2001)

      • Criterion-related validity (ρ = .34)

      • Relationships with ‘g’ (ρ = .46)

  • Group differences/adverse impact?


Alternatives to situational judgment

Alternatives to Situational Judgment

  • Different ways to assess individual judgment in hypothetical situations

  • Situational interview questions

    • Ask applicants to describe how they would respond to hypothetical situations likely to face in future

    • An alternative way to assess situational judgment

  • Current research used a situational interview

    • Assess construct validity and group differences


Method

Method

  • Sample

    • Year 1: 1,023 applicants

    • Year 2: 2,295 applicants

    • Approximately 60% male

    • 4% Hispanic & 3% African-American

  • Selection procedure

    • Part 1: Written test battery

    • Part 2: Assessment center


Method1

Method

  • More detail about situational interview

    • Longer and more involved; emphasized “situational” character

    • Utilized follow-up questions to challenge candidate and make situation more complex/difficult

    • Example question


Method2

Method

  • Written test battery

    • All measures demonstrated adequate reliability

  • Assessment center scoring

    • All exercises rated by multiple assessors on multiple dimensions; high interrater and internal consistency reliability

    • Averaged across dimension to create exercise score

  • Analyses

    • Correlations & d’s


Discussion

Discussion

  • Conclusions

    • As implemented, this type of situational judgment test appears to be independent of ‘g’

    • No group differences (may actually help?)

    • Might be a useful way to assess situational judgment

  • Caveats

    • Is this comparable to a written situational judgment test?

    • Are situational judgment tests simply a measurement method?


  • Login