New machine-marked tests for selection into core medical training: evidence from two validation studies
Authors:
- Fiona PattersonFPFiona Patterson
- Lara ZibarrasLZLara Zibarras
- Simon PlintSPSimon Plint
- Bill IrishBIBill Irish
- Simon GregorySGSimon Gregory
Open Access
- 1 October 2009
- journal article
- research article
- Published by Elsevier in Clinical Medicine
- Vol. 9 (5) , 417-420
Abstract
This study examined whether two machine-marked tests (MMTs; a clinical problem-solving test and situational judgement test), previously validated for selection into UK general practice (GP) training, could provide a valid methodology for shortlisting into core medical training (CMT). A longitudinal design was used to examine the MMTs’ psychometric properties in CMT samples, and correlations between MMT scores and CMT interview outcomes. Independent samples from two years were used: in 2008, a retrospective analysis was conducted (n=1,711), while in 2009, CMT applicants completed the MMTs for evaluation purposes (n=2,265). Both MMTs showed good reliability in CMT samples, similar to GP samples. Both MMTs were good predictors of CMT interview performance (r=0.56, p<0.001 in 2008; r=0.61, p<0.001 in 2009) and offered incremental validity over the current shortlisting process. The GP MMTs offer an appropriate measurement methodology for selection into CMT, representing a significant innovation for selection methodology.Keywords
This publication has 9 references indexed in Scilit:
- Evaluating candidate reactions to selection practices using organisational justice theoryMedical Education, 2011
- Evaluation of three short‐listing methodologies for selection into postgraduate training in general practiceMedical Education, 2008
- A new selection system to recruit general practice registrars: preliminary findings from a validation studyBMJ, 2005
- The Incremental Validity of Psychological Testing and Assessment: Conceptual, Methodological, and Statistical Issues.Psychological Assessment, 2003
- Personnel selectionJournal of Occupational and Organizational Psychology, 2001
- Use of situational judgment tests to predict job performance: A clarification of the literature.Journal of Applied Psychology, 2001
- The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings.Psychological Bulletin, 1998
- The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings.Psychological Bulletin, 1998
- PERSONNEL SELECTIONAnnual Review of Psychology, 1997