What Aspects of Letters of Recommendation Predict Performance in Medical School? Findings From One Institution
Authors:
- Kent J. DeZeeKDKent J. DeZee
- Charles D. MageeCMCharles D. Magee
- Gretchen RickardsGRGretchen Rickards
- Anthony R. ArtinoAAAnthony R. Artino
- William R. GillilandWGWilliam R. Gilliland
- Ting DongTDTing Dong
- Elexis McBeeEMElexis McBee
- Nathalie PaolinoNPNathalie Paolino
- David F. CruessDCDavid F. Cruess
- Steven J. DurningSDSteven J. Durning
- 1 October 2014
- journal article
- Published by Oxford University Press (OUP) in Academic Medicine
- Vol. 89 (10) , 1408-1415
Abstract
To study medical students' letters of recommendation (LORs) from their applications to medical school to determine whether these predicted medical school performance, because many researchers have questioned LORs' predictive validity. A retrospective cohort study of three consecutive graduating classes (2007-2009) at the Uniformed Services University of the Health Sciences was performed. In each class, the 27 students who had been elected into the Alpha Omega Alpha (AOA) Honor Medical Society were defined as top graduates, and the 27 students with the lowest cumulative grade point average (GPA) were designated as "bottom of the class" graduates. For each student, the first three LORs (if available) in the application packet were independently coded by two blinded investigators using a comprehensive list of 76 characteristics. Each characteristic was compared with graduation status (top or bottom of the class), and those with statistical significance related to graduation status were inserted into a logistic regression model, with undergraduate GPA and Medical College Admission Test score included as control variables. Four hundred thirty-seven LORs were included. Of 76 LOR characteristics, 7 were associated with graduation status (P ≤ .05), and 3 remained significant in the regression model. Being rated as "the best" among peers and having an employer or supervisor as the LOR author were associated with induction into AOA, whereas having nonpositive comments was associated with bottom of the class students. LORs have limited value to admission committees, as very few LOR characteristics predict how students perform during medical school.Keywords
This publication has 20 references indexed in Scilit:
- Selection Criteria for Internal Medicine Residency Applicants and Professionalism Ratings During InternshipMayo Clinic Proceedings, 2011
- Selection Criteria for Residency: Results of a National Program Directors SurveyAcademic Medicine, 2009
- Importance of the Faculty Interview During the Resident Application ProcessJournal of Surgical Education, 2007
- What Attributes are Necessary to Be Selected for an Orthopaedic Surgery Residency Position: Perceptions of Faculty and ResidentsSouthern Medical Journal, 2004
- Selection Criteria for Emergency Medicine Residency ApplicantsAcademic Emergency Medicine, 2000
- Predictive value of letters of recommendation vs questionnaires for emergency medicine resident performance.Academic Emergency Medicine, 1997
- FACTORS USED BY PHYSICAL MEDICINE AND REHABILITATION RESIDENCY TRAINING DIRECTORS TO SELECT THEIR RESIDENTSAmerican Journal of Physical Medicine & Rehabilitation, 1994
- Radiology Resident Selection: Results of a SurveyInvestigative Radiology, 1993
- Fantasy LandNew England Journal of Medicine, 1983
- A study of the University of Connecticut's criteria for admission into medical schoolMedical Education, 1981