Medical Student Performance Evaluations in 2005: An Improvement Over the Former Deanʼs Letter?
Authors:
- Judy A. SheaJSJudy A. Shea
- Elizabeth OʼgradyEOElizabeth Oʼgrady
- 1 March 2008
- journal article
- evaluation
- Published by Oxford University Press (OUP) in Academic Medicine
- Vol. 83 (3) , 284-291
Abstract
Purpose To collect information regarding preparation, content, and format of Medical Student Performance Evaluations (MSPEs) and evaluate a sample of 2005 MSPEs to assess compliance with the 2002 Association of American Medical Colleges-issued MSPE guidelines. Method Cross-sectional survey with all 126 U.S. allopathic medical schools. Associate deans of students affairs were sent an eight-item questionnaire in June 2006 and asked to submit a sample of redacted MSPEs for 2005 graduates, choosing one from each tertile of the class. Survey data are summarized. MSPEs were abstracted, and results are presented descriptively. Results The survey response rate was 84%. Most associate deans (71%) reported having primary responsibility for composing MSPEs; 78% adhered to the format and content guidelines three fourths of the time. The abstraction of 293 MSPEs (78%) showed that more than 80% adhered to format recommendations. However, only 70% to 80% stated grades clearly, avoided the word recommendation, and stated whether the student had completed remediation. Fewer than 70% indicated whether the student had had any adverse actions or provided adequate comparative data. Strikingly, only 17% provide comparative data in the summary paragraph. Overall, 75% of the MSPEs were judged to be “adequate.” Conclusions MSPEs are somewhat variable in terms of which specific items are included. There has been steady quality improvement since prior surveys, primarily in formatting and labeling. However, a sizable minority of writers are still using the MSPE as a recommendation, and too few are providing helpful comparative data.Keywords
This publication has 9 references indexed in Scilit:
- Does Medical School Performance Predict Radiology Resident Performance?Academic Radiology, 2002
- A Follow-up Study of the Characteristics of Deanʼs LettersAcademic Medicine, 2001
- The dishonest deanʼs letterAcademic Medicine, 1999
- Outcome measurement in postgraduate year one of graduates from a medical school with a pass/fail grading systemAcademic Medicine, 1999
- Program directorsʼ responses to a survey on variables used to select residents in a time of changeAcademic Medicine, 1999
- Response rates to mail surveys published in medical journalsJournal of Clinical Epidemiology, 1997
- Characteristics of deanʼs letters in 1981 and 1992Academic Medicine, 1993
- First-year residentsʼ performances compared with their medical school class ranks as determined by three ranking systemsAcademic Medicine, 1992
- Fantasy LandNew England Journal of Medicine, 1983