Trends in Study Methods Used in Undergraduate Medical Education Research, 1969-2007
Authors:
- Amy BaernsteinABAmy Baernstein
- Hillary K. LissHLHillary K. Liss
- Patricia A. CarneyPCPatricia A. Carney
- Joann G. ElmoreJEJoann G. Elmore
- 5 September 2007
- journal article
- review article
- Published by American Medical Association (AMA) in JAMA
- Vol. 298 (9) , 1038-1045
Abstract
ContextEvidence-based medical education requires rigorous studies appraising educational efficacy.ObjectivesTo assess trends over time in methods used to evaluate undergraduate medical education interventions and to identify whether participation of medical education departments or centers is associated with more rigorous methods.Data SourcesThe PubMed, Cochrane Controlled Trials Registry, Campbell Collaboration, and ERIC databases (January 1966–March 2007) were searched using terms equivalent to students, medical and education, medical crossed with all relevant study designs.Study SelectionWe selected publications in all languages from every fifth year, plus the most recent 12 months, that evaluated an educational intervention for undergraduate medical students. Four hundred seventy-two publications met criteria for review.Data ExtractionData were abstracted on number of participants; types of comparison groups; whether outcomes assessed were objective, subjective, and/or validated; timing of outcome assessments; funding; and participation of medical education departments and centers. Ten percent of publications were independently abstracted by 2 authors to assess validity of the data abstraction.ResultsThe annual number of publications increased over time from 1 (1969-1970) to 147 (2006-2007). In the most recent year, there was a mean of 145 medical student participants; 9 (6%) recruited participants from multiple institutions; 80 (54%) used comparison groups; 37 (25%) used randomized control groups; 91 (62%) had objective outcomes; 23 (16%) had validated outcomes; 35 (24%) assessed an outcome more than 1 month later; 21 (14%) estimated statistical power; and 66 (45%) reported funding. In 2006-2007, medical education department or center participation, reported in 46 (31%) of the recent publications, was associated only with enrolling more medical student participants (P = .04); for all studies from 1969 to 2007, it was associated only with measuring an objective outcome (P = .048). Between 1969 and 2007, the percentage of publications reporting statistical power and funding increased; percentages did not change for other study features.ConclusionsThe annual number of published studies of undergraduate medical education interventions demonstrating methodological rigor has been increasing. However, considerable opportunities for improvement remain.Keywords
This publication has 47 references indexed in Scilit:
- Problem-Based Learning Outcomes: Ten Years of Experience at the University of Missouri???Columbia School of MedicineAcademic Medicine, 2006
- A Systematic Review of the Methodological Rigor of Studies Evaluating Cultural Competence Training of Health ProfessionalsAcademic Medicine, 2005
- Making sense of qualitative research: a new seriesMedical Education, 2004
- Education Research at the Faculty of Medicine, University of Maastricht: Fostering the Interrelationship between Professional and Education PracticeAcademic Medicine, 2004
- Revisiting the Idea of a National Center for Health Professions Education ResearchAcademic Medicine, 2004
- Medical education as a science: The quality of evidence for computer-assisted instructionAmerican Journal of Obstetrics and Gynecology, 2003
- Researching the outcomes of educational interventions: a matter of designBMJ, 2002
- Identifying, Appraising, and Implementing Medical Education Curricula: A Guide for Medical EducatorsAnnals of Internal Medicine, 2001
- Guidelines for evaluating papers on educational interventions.1999
- Continuing medical education and career choice among graduates of problem‐based and traditional curriculaMedical Education, 1991