Pilot Study Evaluating a Practice-Based Learning and Improvement Curriculum Focusing on the Development of System-Level Quality Improvement Skills
Authors:
- Anne M TomoloATAnne M Tomolo
- Renée H LawrenceRLRenée H Lawrence
- Brook WattsBWBrook Watts
- Sarah AugustineSASarah Augustine
- David C AronDADavid C Aron
- Mamta K SinghMSMamta K Singh
- 1 March 2011
- journal article
- Published by Journal of Graduate Medical Education in Journal of Graduate Medical Education
- Vol. 3 (1) , 49-58
Abstract
Background: We developed a practice-based learning and improvement (PBLI) curriculum to address important gaps in components of content and experiential learning activities through didactics and participation in systems-level quality improvement projects that focus on making changes in health care processes. Methods: We evaluated the impact of our curriculum on resident PBLI knowledge, self-efficacy, and application skills. A quasi-experimental design assessed the impact of a curriculum (PBLI quality improvement systems compared with non-PBLI) on internal medicine residents' learning during a 4-week ambulatory block. We measured application skills, self-efficacy, and knowledge by using the Systems Quality Improvement Training and Assessment Tool . Exit evaluations assessed time invested and experiences related to the team projects and suggestions for improving the curriculum. Results: The 2 groups showed differences in change scores. Relative to the comparison group, residents in the PBLI curriculum demonstrated a significant increase in the belief about their ability to implement a continuous quality improvement project ( P = .020), comfort level in developing data collection plans ( P = .010), and total knowledge scores ( P < .001), after adjusting for prior PBLI experience. Participants in the PBLI curriculum also demonstrated significant improvement in providing a more complete aim statement for a proposed project after adjusting for prior PBLI experience ( P = .001). Exit evaluations were completed by 96% of PBLI curriculum participants who reported high satisfaction with team performance. Conclusion: Residents in our curriculum showed gains in areas fundamental for PBLI competency. The observed improvements were related to fundamental quality improvement knowledge, with limited gain in application skills. This suggests that while heading in the right direction, we need to conceptualize and structure PBLI training in a way that integrates it throughout the residency program and fosters the application of this knowledge and these skills.Keywords
This publication has 32 references indexed in Scilit:
- Development and Preliminary Evaluation of a Practice-Based Learning and Improvement Tool for Assessing Resident Competence and Guiding Curriculum DevelopmentJournal of Graduate Medical Education, 2011
- Using the American Board of Internal Medicine Practice Improvement Modules to Teach Internal Medicine Residents Practice ImprovementJournal of Graduate Medical Education, 2010
- The Department of Veterans Affairs National Quality Scholars Fellowship Program: Experience From 10 Years of Training Quality ScholarsAcademic Medicine, 2009
- Shared Medical AppointmentsQuality Management in Health Care, 2009
- Resident Self-Assessment and Self-Reflection: University of Wisconsin-Madison’s Five-Year StudyJournal of General Internal Medicine, 2009
- A Self-instructional Model to Teach Systems-based Practice and Practice-based Learning and ImprovementJournal of General Internal Medicine, 2008
- Teaching Internal Medicine Residents Quality Improvement Techniques using the ABIM’s Practice Improvement ModulesJournal of General Internal Medicine, 2008
- Validation of a Method for Assessing Resident Physicians’ Quality Improvement ProposalsJournal of General Internal Medicine, 2007
- What is "quality improvement" and how can it transform healthcare?Quality and Safety in Health Care, 2007
- Development of a Diabetes Care Management Curriculum in a Family Practice Residency ProgramDisease Management, 2004