Measuring differential attainment: a longitudinal analysis of assessment results for 1512 medical students at four Scottish medical schools
Authors:
Open Access
Abstract
Objective: To measure Differential Attainment (DA) among Scottish medical students and to explore whether attainment gaps increase or decrease during medical school.Design: A retrospective analysis of undergraduate medical student performance on written assessment, measured at the start and end of medical school.Setting: Four Scottish medical schools (universities of Aberdeen, Dundee, Edinburgh and Glasgow).Participants: 1512 medical students who attempted (but did not necessarily pass) final written assessment.Main outcome measures: The study modelled the change in attainment gap during medical school for four student demographical categories (white/non-white, international/Scottish domiciled, male/female and with/without a known disability) to test whether the attainment gap grew, shrank or remained stable during medical school. Separately, the study modelled the expected versus actual frequency of different demographical groups in the top and bottom decile of the cohort.Results: The attainment gap grew significantly for white versus non-white students (t(449.39)=7.37, p=0.001,d=0.49 and 95% CI 0.34 to 0.58), for internationally domiciled versus Scottish-domiciled students (t(205.8) = −7, p=0.01,d=0.61 and 95% CI –0.75 to −0.42) and for male versus female students (t(1336.68)=3.54, p=0.01,d=0.19 and 95% CI 0.08 to 0.27). International, non-white and male students received higher marks than their comparison group at the start of medical school but lower marks by final assessment. No significant differences were observed for disability status. Students with a known disability, Scottish students and non-white students were over-represented in the bottom decile and under-represented in the top decile.Conclusions: The tendency for attainment gaps to grow during undergraduate medical education suggests that educational factors at medical schools may—however inadvertently—contribute to DA. It is of critical importance that medical schools investigate attainment gaps within their cohorts and explore potential underlying causes.Keywords
Funding Information
- Scottish Medical Education Research Consortium (Grant ID: "Evaluating fairness in assessment")
This publication has 37 references indexed in Scilit:
- Ethnicity and academic performance in UK trained doctors and medical students: systematic review and meta-analysisBMJ, 2011
- Assessment for selection for the health care professions and specialty training: Consensus statement and recommendations from the Ottawa 2010 ConferenceMedical Teacher, 2011
- Graduates of different UK medical schools show substantial differences in performance on MRCP(UK) Part 1, Part 2 and PACES examinationsBMC Medicine, 2008
- Selection Effects on Applications and Admissions to Medical Education with Regular and Step?Wise Admission ProceduresScandinavian Journal of Educational Research, 2006
- Measuring Multiple Deprivation at the Small-Area LevelEnvironment and Planning A: Economy and Space, 2006
- Survival Bias Associated with Time-to-Treatment Initiation in Drug Effectiveness Evaluation: A Comparison of MethodsAmerican Journal of Epidemiology, 2005
- A Hazard Model of the Probability of Medical School Drop-Out in the UKJournal of the Royal Statistical Society Series A: Statistics in Society, 2003
- Invalidation of Parametric and Nonparametric Statistical Tests by Concurrent Violation of Two AssumptionsThe Journal of Experimental Education, 1998
- A power primer.Psychological Bulletin, 1992
- An analysis of variance test for normality (complete samples)Biometrika, 1965