Evidence-based appraisal of the role of SJTs in selection
Open Access
- 5 December 2023
- journal article
- research article
- Published by Elsevier in Clinical Medicine
- Vol. 23 (6) , 641-642
Abstract
A recent opinion article in Clinical Medicine promoted a new preference-based algorithm to allocate training places for the UK Foundation Programme Office (UKFPO). This replaced the previous process, which ranked candidates based on medical school academic achievement (the educational performance measure; EPM) and the score on a situational judgement test (SJT). Although not without risks, we believe that the new system has positive potential. In presenting their case, Sam et al summarised evidence relating to the UKFPO in an unbalanced way, leading to what we believe are erroneous inferences, particularly with regard to differential attainment. Here, we provide an example of how the general evidence base and conceptual understanding of the validity of SJTs for medical selection is poorly understood. We highlight important research findings that were not cited by Sam et al and provide what we believe is a more balanced and accurate interpretation of the evidence base relating the UKFPO SJT, and SJTs used in medical selection in general. We do this with particular reference to the validity of such tools in this context, as well as their potential impact on under-represented groups in medicine, compared with other selection assessments.Keywords
This publication has 12 references indexed in Scilit:
- Situational judgement test performance and subsequent misconduct in medical studentsMedical Education, 2022
- Is Academic Attainment or Situational Judgment Test Performance in Medical School Associated With the Likelihood of Disciplinary Action? A National Retrospective Cohort StudyAcademic Medicine, 2021
- ‘10% of your medical students will cause 90% of your problems’: a prospective correlational studyBMJ Open, 2020
- Situational judgement test validity for selection: A systematic review and meta‐analysisMedical Education, 2020
- Differential attainment in medical education and trainingBMJ, 2020
- Situational judgement tests for selection: Traditional vs construct‐driven approachesMedical Education, 2019
- Evaluating the validity of the selection measures used for the UK’s foundation medical training programme: a national cohort studyBMJ Open, 2018
- Evaluating the complementary roles of an SJT and academic assessment for entry into clinical practiceAdvances in Health Sciences Education, 2017
- Subgroup Differences in Situational Judgment Test Performance: A Meta-AnalysisHuman Performance, 2008
- SITUATIONAL JUDGMENT TESTS, RESPONSE INSTRUCTIONS, AND VALIDITY: A META‐ANALYSISPersonnel Psychology, 2007