Optimizing the post-graduate institutional program evaluation process
Authors:
- Monica L. LypsonMLMonica L. Lypson
- Mark E. P. PrinceMPMark E. P. Prince
- Steven J. KastenSKSteven J. Kasten
- Nicholas H. OsborneNONicholas H. Osborne
- Richard H. CohanRCRichard H. Cohan
- Terry KowalenkoTKTerry Kowalenko
- Paul J. DoughertyPDPaul J. Dougherty
- R. Kevin ReynoldsRRR. Kevin Reynolds
- M. Catherine SpiresMSM. Catherine Spires
- Jeffrey H. KozlowJKJeffrey H. Kozlow
- Scott D. GitlinSGScott D. Gitlin
Open Access
- 17 February 2016
- journal article
- research article
- Published by Springer Nature in BMC Medical Education
- Vol. 16 (1) , 1-6
Abstract
Reviewing program educational efforts is an important component of postgraduate medical education program accreditation. The post-graduate review process has evolved over time to include centralized oversight based on accreditation standards. The institutional review process and the impact on participating faculty are topics not well described in the literature. We conducted multiple Plan-Do-Study-Act (PDSA) cycles to identify and implement areas for change to improve productivity in our institutional program review committee. We also conducted one focus group and six in-person interviews with 18 committee members to explore their perspectives on the committee’s evolution. One author (MLL) reviewed the transcripts and performed the initial thematic coding with a PhD level research associate and identified and categorized themes. These themes were confirmed by all participating committee members upon review of a detailed summary. Emergent themes were triangulated with the University of Michigan Medical School’s Admissions Executive Committee (AEC). We present an overview of adopted new practices to the educational program evaluation process at the University of Michigan Health System that includes standardization of meetings, inclusion of resident members, development of area content experts, solicitation of committed committee members, transition from paper to electronic committee materials, and focus on continuous improvement. Faculty and resident committee members identified multiple improvement areas including the ability to provide high quality reviews of training programs, personal and professional development, and improved feedback from program trainees. A standing committee that utilizes the expertise of a group of committed faculty members and which includes formal resident membership has significant advantages over ad hoc or other organizational structures for program evaluation committees.Keywords
Funding Information
- University of Michigan Internal Funding
This publication has 10 references indexed in Scilit:
- A Citation Tracking System to Facilitate Sponsoring Institution Oversight of ACGME-Accredited ProgramsJournal of Graduate Medical Education, 2012
- The Next GME Accreditation System — Rationale and BenefitsNew England Journal of Medicine, 2012
- Internal Reviews Benefit Programs of the Review Team Members and the Program Under ReviewJournal of Graduate Medical Education, 2010
- Use of an Institutional Template for Annual Program Evaluation and Improvement: Benefits for Program Participation and PerformanceJournal of Graduate Medical Education, 2010
- A case study of translating ACGME practice-based learning and improvement requirements into reality: systems quality improvement projects as the key component to a comprehensive curriculumPostgraduate Medical Journal, 2009
- Basics of Qualitative Research (3rd ed.): Techniques and Procedures for Developing Grounded Theory2008
- A Conceptual Model for Program Evaluation in Graduate Medical EducationAcademic Medicine, 2006
- Improving Oversight of the Graduate Medical Education Enterprise: One Institution???s Strategies and ToolsAcademic Medicine, 2006
- An Institutional System to Monitor and Improve the Quality of Residency EducationAcademic Medicine, 2004
- The PDSA Cycle at the Core of Learning in Health Professions EducationThe Joint Commission Journal on Quality Improvement, 1996