Correlation of selection scores with subsequent assessment scores during surgical training
- 6 May 2013
- journal article
- research article
- Published by Wiley in Anz Journal of Surgery
- Vol. 83 (6) , 412-416
Abstract
Background: Determining admission criteria to select candidates most likely to succeed in surgical training in Australia and New Zealand has been an imprecise art with little empirical evidence informing decisions. Selection to the Royal Australasian College of Surgeons' Surgical Education and Training programme is based entirely on applicants' performance in structured curriculum vitae (CV), referees' reports and interviews. This retrospective review compared General Surgery (GS) trainees' performance in selection with subsequent performance in assessments during training.Methods: Data from three cohorts of GS trainees were sourced. Scores for four selection items were compared with scores from six training assessments. Interrelationships within each of the sets of selection and assessment variables were determined.Results: A single significant relationship was found between scores on the three selection tools. High scores in the CV did not correlate with higher scores in any subsequent assessments. The structured referee report score, multi‐station interview score and total selection score all correlated with performance in subsequent work‐based assessments and examinations. Direct observation of procedural skills (DOPS) scores appear to reflect increasing acquisition of operative skills. Performance in mini clinical examinations (Mini‐CEX) was variable, perhaps reflecting limitations of this assessment. Candidates who perform well in one examination tend to perform well in all three examinations.Conclusions: No selection tool demonstrated strong relationships with scores in all subsequent assessments; however referee reports, multi‐station interviews and total selection scores are indicators for performance in particular assessments. This may engender confidence that candidates admitted into the GS training programme are likely to progress successfully through the programme.Keywords
This publication has 13 references indexed in Scilit:
- Making sense of work‐based assessment: ask the right questions, in the right way, about the right things, of the right peopleMedical Education, 2011
- Predictive validity of the multiple mini‐interview for selecting medical traineesMedical Education, 2009
- Role and feasibility of psychomotor and dexterity testing in selection for surgical trainingAnz Journal of Surgery, 2009
- Training tomorrow’s surgeons: what are we looking for and how can we achieve it?Anz Journal of Surgery, 2009
- Surgical Education and Training in Australia and New ZealandWorld Journal of Surgery, 2008
- Implementing workplace‐based assessment across the medical specialties in the United KingdomMedical Education, 2008
- Multiple mini‐interviews predict clerkship and licensing examination performanceMedical Education, 2007
- Workplace-based assessment as an educational tool: AMEE Guide No. 31Medical Teacher, 2007
- Relation of Residency Selection Factors to Subsequent Orthopaedic In-training Examination PerformanceSouthern Medical Journal, 2005
- The Ability of the Multiple Mini-Interview to Predict Preclerkship Performance in Medical SchoolAcademic Medicine, 2004