Situational judgement tests for selection: Traditional vs construct‐driven approaches
- 23 December 2019
- journal article
- research article
- Published by Wiley in Medical Education
- Vol. 54 (2) , 105-115
Abstract
Context: Historically, situational judgement tests ( SJT s) have been widely used for personnel selection. Their use in medical selection in Europe is growing, with plans for further expansion into North America and Australasia, in an attempt to measure and select on ‘non‐academic’ personal attributes. However, there is a lack of clarity regarding what such tests actually measure and how they should be designed, scored and implemented within the medical and health education selection process. In particular, the theoretical basis from which such tests are developed will determine the scoring options available, influencing their psychometric properties and, ultimately, their validity. Methods: The aim of this article is to create an awareness of the previous theory and practice that has informed SJT development. We describe the emerging interest in the use of the SJT format to measure specific constructs (eg ‘resilience’, ‘dependability’, etc.), drawing on the tradition of ‘individual differences’ psychology. We compare and contrast this newer ‘construct‐driven’ method with the traditional, pragmatic approach to SJT creation, often employed by organisational psychologists. Making reference to measurement theory, we highlight how the anticipated psychometric properties of traditional vs construct‐driven SJT s are likely to differ. Conclusions: Compared to traditional SJT s, construct‐driven SJT s have a strong theoretical basis, are uni‐ rather than multidimensional, and may behave more like personality self‐report instruments. Emerging evidence also suggests that construct‐driven SJT s have comparable predictive validity for workplace performance, although they may be more prone to ‘faking’ effects. It is possible that construct‐driven approaches prove more appropriate at early stages of medical selection, where candidates have little or no health care work experience. Conversely, traditional SJT s may be more suitable for specialty recruitment, where a range of hypothetical workplace scenarios can be sampled in assessments.Keywords
Funding Information
- National Institute for Health Research
This publication has 62 references indexed in Scilit:
- Comparison of the sensitivity of the UKCAT and A Levels to sociodemographic characteristics: a national studyBMC Medical Education, 2014
- Development and Validation of a Situational Judgment Test of Emotional IntelligenceInternational Journal of Selection and Assessment, 2013
- Fair and equal assessment in postgraduate training? A future research agendaBritish Journal of General Practice, 2011
- On the Use, the Misuse, and the Very Limited Usefulness of Cronbach’s AlphaPsychometrika, 2009
- Estimating Trait and Situational Variance in a Situational Judgment TestHuman Performance, 2009
- SITUATIONAL JUDGMENT TESTS, RESPONSE INSTRUCTIONS, AND VALIDITY: A META‐ANALYSISPersonnel Psychology, 2007
- Effects of Response Instructions on Faking a Situational Judgment TestInternational Journal of Selection and Assessment, 2005
- Convergent and discriminant validation by the multitrait-multimethod matrix.Psychological Bulletin, 1959
- Note on the Cardall Practical Judgment Test.Journal of Applied Psychology, 1949
- Concepts of trait and personality.Psychological Bulletin, 1927