Evaluations of situational judgement tests to assess non‐academic attributes in selection
- 15 August 2012
- journal article
- research article
- Published by Wiley in Medical Education
- Vol. 46 (9) , 850-868
Abstract
Medical Education 2012: 46 : 850–868 Objectives This paper presents a systematic review of the emerging international research evidence for the use of situational judgement tests (SJTs) for testing important non‐academic attributes (such as empathy, integrity and resilience) in selection processes. Methods Several databases (e.g. MEDLINE, PsycINFO, Web of Science) were searched to retrieve empirical studies relating to SJTs published between 1990 and 2010. Personal contact with experts in the field was made to identify any unpublished research or work in progress to obtain the most current material. Finally, reference lists were checked to access other relevant journal articles and further research. All research studies were required to meet specific inclusion criteria selected by two independent reviewers. Results Over 1000 citations were identified during the initial literature search; following the review of abstracts, full‐text copies of 76 articles were retrieved and evaluated. A total of 39 articles that adequately met the inclusion criteria were included in the final review. The research evidence shows that, compared with personality and IQ tests, SJTs have good levels of reliability, predictive validity and incremental validity for testing a range of professional attributes, such as empathy and integrity. Conclusions SJTs can be designed to test a broad range of non‐academic constructs depending on the selection context. As a relatively low‐fidelity assessment, SJTs are a cost‐efficient methodology compared with high‐fidelity assessments of non‐academic attributes, such as those used in objective structured clinical examinations. In general, SJTs are found to demonstrate less adverse impact than IQ tests and are positively received by candidates. Further research is required to explore theoretical developments and the underlying construct validity of SJTs.Keywords
This publication has 56 references indexed in Scilit:
- Evaluating cognitive ability, knowledge tests and situational judgement tests for postgraduate selectionMedical Education, 2012
- Fair and equal assessment in postgraduate training? A future research agendaBritish Journal of General Practice, 2011
- Ethnicity and academic performance in UK trained doctors and medical students: systematic review and meta-analysisBMJ, 2011
- Assessment for selection for the health care professions and specialty training: Consensus statement and recommendations from the Ottawa 2010 ConferenceMedical Teacher, 2011
- Evaluating candidate reactions to selection practices using organisational justice theoryMedical Education, 2011
- Differentiating specific job knowledge from implicit trait policies in procedural knowledge measured by a situational judgment test.Journal of Applied Psychology, 2010
- New machine-marked tests for selection into core medical training: evidence from two validation studiesClinical Medicine, 2009
- Use of situational judgment tests to predict job performance: A clarification of the literature.Journal of Applied Psychology, 2001
- THE RELATIONSHIP BETWEEN WORK EXPERIENCE AND JOB PERFORMANCE: A CONCEPTUAL AND META‐ANALYTIC REVIEWPersonnel Psychology, 1995
- Meta-analysis of assessment center validity.Journal of Applied Psychology, 1987