Medical School Admissions: Enhancing the Reliability and Validity of an Autobiographical Screening Tool
Authors:
- Kelly L. DoreKDKelly L. Dore
- Mark HansonMHMark Hanson
- Harold I. ReiterHRHarold I. Reiter
- Melanie BlanchardMBMelanie Blanchard
- Karen DeethKDKaren Deeth
- Kevin W. EvaKEKevin W. Eva
- 1 October 2006
- journal article
- Published by Oxford University Press (OUP) in Academic Medicine
- Vol. 81 (Suppl) , S70-S73
Abstract
Most medical school applicants are screened out preinterview. Some cognitive scores available preinterview and some noncognitive scores available at interview demonstrate reasonable reliability and predictive validity. A reliable preinterview noncognitive measure would relax dependence upon screening based entirely on cognitive tendencies. In 2005, applicants interviewing at McMaster University's Michael G. DeGroote School of Medicine completed an offsite, noninvigilated, Autobiographical Submission (ABS) preinterview and another onsite, invigilated, ABS at interview. Traditional and new ABS scoring methods were compared, with raters either evaluating all ABS questions for each candidate in turn (vertical scoring-traditional method) or evaluating all candidates for each question in turn (horizontal scoring-new method). The new scoring method revealed lower internal consistency and higher interrater reliability relative to the traditional method. More importantly, the new scoring method correlated better with the Multiple Mini-Interview (MMI) relative to the traditional method. The new ABS scoring method revealed greater interrater reliability and predictive capacity, thus increasing its potential as a screen for noncognitive characteristics.Keywords
This publication has 7 references indexed in Scilit:
- APPLIED RESEARCH: Reflecting the Relative Values of Community, Faculty, and Students in the Admissions Tools of Medical SchoolTeaching and Learning in Medicine, 2005
- The Ability of the Multiple Mini-Interview to Predict Preclerkship Performance in Medical SchoolAcademic Medicine, 2004
- An admissions OSCE: the multiple mini‐interviewMedical Education, 2004
- A Standardized Open-Ended Questionnaire as a Substitute for a Personal Interview in Dental AdmissionsJournal of Dental Education, 2003
- Validity of Admissions Measures in Predicting Performance Outcomes: The Contribution of Cognitive and Non-Cognitive DimensionsTeaching and Learning in Medicine, 2002
- Reliability and Validity of Admissions Tools Used to Select Students for the Health ProfessionsAdvances in Health Sciences Education, 2001
- Generalizability theory.American Psychologist, 1989