RE-AIM for rural health innovations: perceptions of (mis) alignment between the RE-AIM framework and evaluation reporting in the Department of Veterans Affairs Enterprise-Wide Initiatives program
Open Access
- 9 April 2024
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Health Services
- Vol. 4, 1278209
Abstract
Background: The Department of Veterans Affairs (VA) Office of Rural Health (ORH) supports national VA program offices' efforts to expand health care to rural Veterans through its Enterprise-Wide Initiatives (EWIs) program. In 2017, ORH selected Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM), an implementation science framework, to structure the EWI evaluation and reporting process. As part of its mandate to improve EWI program evaluation, the Center for the Evaluation of Enterprise-Wide Initiatives conducted a qualitative evaluation to better understand EWI team' perceptions of, and barriers and facilitators to, the EWI evaluation process.Methods: We conducted 43 semi-structured interviews with 48 team members (e.g., evaluators, program office leads, and field-based leads) representing 21 EWIs from April-December 2020. Questions focused on participants' experiences using strategies targeting each RE-AIM dimension. Interviews were inductively analyzed in MAXQDA. We also systematically reviewed 51 FY19-FY20 EWI annual reports to identify trends in misapplications of RE-AIM.Results: Participants had differing levels of experience with RE-AIM. While participants understood ORH's rationale for selecting a common framework to structure evaluations, the perceived misalignment between RE-AIM and EWIs' work emerged as an important theme. Concerns centered around 3 sub-themes: (1) (Mis)Alignment with RE-AIM Dimensions, (2) (Mis)Alignment between RE-AIM and the EWI, and (3) (Mis)Alignment with RE-AIM vs. other Theories, Models, or Frameworks. Participants described challenges differentiating between and operationalizing dimensions in unique contexts. Participants also had misconceptions about RE-AIM and its relevance to their work, e.g., that it was meant for established programs and did not capture aspects of initiative planning, adaptations, or sustainability. Less commonly, participants shared alternative models or frameworks to RE-AIM. Despite criticisms, many participants found RE-AIM useful, cited training as important to understanding its application, and identified additional training as a future need.Discussion: The selection of a shared implementation science framework can be beneficial, but also challenging when applied to diverse initiatives or contexts. Our findings suggest that establishing a common understanding, operationalizing framework dimensions for specific programs, and assessing training needs may better equip partners to integrate a shared framework into their evaluations.Keywords
This publication has 32 references indexed in Scilit:
- Introducing clinical pharmacy specialists into interprofessional primary care teamsMedicine, 2021
- Use of Video Telehealth Tablets to Increase Access for Veterans Experiencing HomelessnessJournal of General Internal Medicine, 2021
- Understanding and applying the RE-AIM framework: Clarifications and resourcesJournal of Clinical and Translational Science, 2021
- Protocol to evaluate an enterprise-wide initiative to increase access to lung cancer screening in the Veterans Health AdministrationClinical Imaging, 2020
- Using the Practical, Robust Implementation and Sustainability Model (PRISM) to qualitatively assess multilevel contextual factors to help plan, implement, evaluate, and disseminate health services programsTranslational Behavioral Medicine, 2019
- Qualitative approaches to use of the RE-AIM framework: rationale and methodsBMC Health Services Research, 2018
- Purposeful Sampling for Qualitative Data Collection and Analysis in Mixed Method Implementation ResearchAdministration and Policy in Mental Health and Mental Health Services Research, 2013
- Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation scienceImplementation Science, 2009
- A Practical, Robust Implementation and Sustainability Model (PRISM) for Integrating Research Findings into PracticeThe Joint Commission Journal on Quality and Patient Safety, 2008
- The PARIHS Framework—A Framework for Guiding the Implementation of Evidence-based PracticeJournal of Nursing Care Quality, 2004