Comprehensive undergraduate medical assessments improve prediction of clinical performance
Authors:
- 1 October 2004
- journal article
- Published by Wiley in Medical Education
- Vol. 38 (10) , 1111-1116
Abstract
Objectives This study aimed to compare an essay‐style undergraduate medical assessment with modified essay, multiple‐choice question (MCQ) and objective structured clinical examination (OSCE) undergraduate medical assessments in predicting students' clinical performance (predictive validity), and to determine the relative contributions of the written (modified essay and MCQ) assessment and OSCE to predictive validity. Design Before and after cohort study. Setting One medical school running a 6‐year undergraduate course. Participants Study participants included 137 Year 5 medical students followed into their trainee intern year. Main outcome measures Aggregated global ratings by senior doctors, junior doctors and nurses as well as comprehensive structured assessments of performance in the trainee intern year. Results Students' scores in the new examinations predicted performance significantly better than scores in the old examinations, with correlation coefficients increasing from 0.05−0.44 to 0.41–0.81. The OSCE was a stronger predictor of subsequent performance than the written assessments but combining assessments had the strongest predictive validity. Conclusion Using more comprehensive, more reliable and more authentic undergraduate assessment methods substantially increases predictive validity.Keywords
This publication has 25 references indexed in Scilit:
- The relationship between competence and performance: implications for assessing practice performanceMedical Education, 2002
- Between a rock and a hard place: finding a place for the OSCE in medical educationMedical Education, 2002
- Assessment of clinical competenceThe Lancet, 2001
- Validity of final examinations in undergraduate medical trainingBMJ, 2000
- Testing for predictive validity in health care education researchAcademic Medicine, 1994
- The relationship of academic measures in medical school to performance after graduationAcademic Medicine, 1993
- A case of mistaken identityAcademic Medicine, 1993
- The assessment of clinical skills/competence/performanceAcademic Medicine, 1990
- Cognitive and noncognitive factors in predicting the clinical performance of medical school graduatesAcademic Medicine, 1988
- Relationships between performance in medical school and first postgraduate yearAcademic Medicine, 1979