Development and Evaluation of a Student-Initiated Test Preparation Program for the USMLE Step 1 Examination
- 14 December 2017
- journal article
- research article
- Published by Taylor & Francis in Teaching and Learning in Medicine
- Vol. 30 (2) , 193-201
Abstract
Problem: Studies have documented performance on the United States Medical Licensing Examination® (USMLE) Step 1 exam as an important factor that residency program directors consider when deciding which applicants to interview and rank. Therefore, success on this exam, though only one aspect of applicant evaluation, is important in determining future career prospects for medical students. Unfortunately, mean test scores at the University of Illinois College of Medicine at Chicago (UIC) have historically been below the national average. Intervention: This retrospective and quasi-experimental mixed-methods study describes the development, evaluation, and effects of a student-initiated USMLE Step 1 preparatory program at UIC. The program provided second year students with First Aid for the USMLE Step 1 at the beginning of the academic year, as well as a six month subscription to the USMLE World question bank midyear. In addition, optional peer review sessions covering basic sciences and organ systems were taught by high-performing upperclassmen. The goals of the program were to raise mean USMLE Step 1 exam scores and increase the percentage of students passing the exam on their first time. Context: The program premiered during the 2012–13 academic year. Data from this cohort as well as four others (N = 830; 2010–2014 examinees) were gathered. Performances between preintervention (2010–12 examinees) and postintervention (2013–14 examinees) cohorts of students were compared. Focus groups and interviews with staff and students were conducted, recorded, and analyzed to investigate the impact that the program had on student interactions and perceptions of the learning environment. Outcome: There was a significant difference in exam performance pre- versus postintervention, with average USMLE Step 1 scores improving by 8.82 points following the implementation of the student-initiated program, t(5.61) = 828, p < .001. The average first-attempt pass rate also increased significantly by 8%, χ2(1) = 23.13, p < .001. Taking age, sex, Medical College Admission Test® scores, and undergraduate grade point average into account, students who participated in the program scored 6.57 points higher than students who did not participate in the program (R2 = 0.3), F(5, 886) = 76.71, p < .01, and had higher odds of passing USMLE Step 1 (odds ratio = 3.08, SE = 1.07, p < .01). Students and staff commented on the sense of community and empowerment the program created as well as the unique student-driven nature of the program. Lessons Learned: This study demonstrates the efficacy of a student-initiated curriculum and provides guidance for development and implementation of examination preparatory efforts at other institutions.Keywords
This publication has 12 references indexed in Scilit:
- Peer-assisted learning – Beyond teaching: How can medical students contribute to the undergraduate curriculum?Medical Teacher, 2014
- Cause or effect? The relationship between student perception of the medical school learning environment and academic performance on USMLE Step 1Medical Teacher, 2013
- Second‐year medical students’ motivational beliefs, emotions, and achievementMedical Education, 2010
- The Impact of a Peer-Designed and -Led USMLE Step 1 Review Course: Improvement in Preparation and ScoresAcademic Medicine, 2010
- Medical Schools in the United States, 2009-2010JAMA, 2010
- Promoting student-centered active learning in lectures with a personal response systemAdvances in Physiology Education, 2009
- The Reputation of Medical Education Research: Quasi-Experimentation and Unresolved Threats to ValidityTeaching and Learning in Medicine, 2008
- Peer teaching in medical education: twelve reasons to move from theory to practiceMedical Teacher, 2007
- A Purposeful Approach to the Constant Comparative Method in the Analysis of Qualitative InterviewsQuality & Quantity, 2002
- Undergraduate Institutional MCAT Scores as Predictors of USMLE Step 1 PerformanceAcademic Medicine, 2002