Investigating the Reliability of the Medical School Admissions Interview
Authors:
- Clarence D. KreiterCKClarence D. Kreiter
- Ping YinPYPing Yin
- Catherine SolowCSCatherine Solow
- Robert L. BrennanRBRobert L. Brennan
- 1 June 2004
- journal article
- Published by Springer Nature in Advances in Health Sciences Education
- Vol. 9 (2) , 147-159
Abstract
Purpose: Determining the valid andfair use of the interview for medical schooladmissions is contingent upon a demonstrationof the reproducibility of interview scores. This study seeks to establish thegeneralizability of interview scores, firstassessing the existing research evidence, andthen analyzing data from a non-experimentalindependent replications research design.Methods: Multivariate andunivariate generalizability analyses areconducted using data from a structuredinterview obtained from a population of medicalschool applicants over two years.Results: The existing literaturedoes not provide sufficient evidence regardinginterview reliability. In this study,interview scores derived from a standardizedinterview were found to display low to moderatelevels of reliability. Interview scores do notappear to possess the level of precision foundwith other measures commonly used to facilitateadmissions decisions.Discussion/Conclusion: Given theresults obtained, the fairness of using theinterview as a highly influential component ofthe admission process is called into question. Methods for using interview data in apsychometrically defensible fashion arediscussed. Specifically, attention to decisionreliability provides guidance on how interviewscores can best be integrated into theadmissions process.Keywords
This publication has 15 references indexed in Scilit:
- An admissions OSCE: the multiple mini‐interviewMedical Education, 2004
- Assessing Personal Qualities in Medical School AdmissionsAcademic Medicine, 2003
- Reliability and Validity of Admissions Tools Used to Select Students for the Health ProfessionsAdvances in Health Sciences Education, 2001
- Generalizability Theory2001
- A Structured Interview for Medical School Admission, Phase 1Academic Medicine, 2001
- Measuring Emotional Intelligence of Medical School ApplicantsAcademic Medicine, 2000
- Reliability and validity of interviewersʼ judgments of medical school candidatesAcademic Medicine, 1996
- Influence of medical school applicantsʼ demographic and cognitive characteristics on interviewersʼ ratings of noncognitive traitsAcademic Medicine, 1995
- Current practices in admission interviews at U.S. medical schoolsAcademic Medicine, 1991
- The interview in the admission processAcademic Medicine, 1990