Applying the major system change framework to evaluate implementation of rapid healthcare system change: a case study of COVID-19 remote home monitoring services
Authors:
Open Access
- 3 March 2025
- journal article
- research article
- Published by Springer Nature in Implementation Science Communications
- Vol. 6 (1) , 1-12
Abstract
A framework to evaluate implementation of Major System Change (MSC) in healthcare has been developed and applied to implementation of longer-term system changes. This was the first study to apply the five domains of the MSC framework to rapid healthcare system change. We aimed to: i) evaluate implementation of rapid MSC, using England COVID-19 remote home monitoring services as a case study and ii) consider whether and how the MSC framework can be applied to rapid MSC. A mixed-methods rapid evaluation in England, across 28 primary and secondary healthcare sites (October 2020-November 2021; data collection: 4 months). We conducted 126 interviews (5 national leads, 59 staff, 62 patients/carers) and surveyed staff (n = 292) and patients/carers (n = 1069). Service providers completed cost surveys. Aggregated and patient-level national datasets were used to explore enrolment, service use and clinical outcomes. The MSC framework was applied retrospectively. Qualitative data were analysed thematically to explore key themes within each MSC framework domain. Descriptive statistics and multivariate analyses were used to analyse experience, costs, service use and clinical outcomes. Decision to change/Decision on model: Service development happened concurrently: i) early local development motivated by urgent clinical need, ii) national rollout using standard operating procedures, and iii) local implementation and adaptation. Implementation approach: Services were tailored to local needs to consider patient, staff, organisational and resource factors. Implementation outcomes: Patient enrolment was low (59% services <10%). Service models and implementation approaches varied substantially. Intervention outcomes: No associations found between services and clinical outcomes. Patient and staff experiences were generally positive. However, barriers to delivery and engagement were found; with some groups finding it harder to engage. Low enrolment rates and substantial variation due to tailoring services to local contexts meant it was not possible to conclusively determine service effectiveness. Process outcomes indicated areas of improvement. The MSC framework can be used to analyse rapid MSC. Implementation and factors influencing implementation may differ to non-rapid contexts (e.g. less uniformity, more tailoring). Our mixed-methods approach could inform future evaluations of large-scale rapid and non-rapid MSC in a range of conditions and services internationally.Keywords
Funding Information
- Health and Social Care Delivery Research Programme (16/138/17, 16/138/31)
This publication has 26 references indexed in Scilit:
- Patient and staff experiences of using technology-enabled and analogue models of remote home monitoring for COVID-19 in England: A mixed-method evaluationInternational Journal of Medical Informatics, 2023
- Patients' experiences of, and engagement with, remote home monitoring services for COVID‐19 patients: A rapid mixed‐methods studyHealth Expectations, 2022
- The impact of post-hospital remote monitoring of COVID-19 patients using pulse oximetry: A national observational study using hospital activity dataeClinicalMedicine, 2022
- The impact of remote home monitoring of people with COVID-19 using pulse oximetry: A national population and observational studyeClinicalMedicine, 2022
- Remote home monitoring (virtual wards) for confirmed or suspected COVID-19 patients: a rapid systematic revieweClinicalMedicine, 2021
- Covid-19: “Life on hold” for NHS patients needing musculoskeletal careBMJ, 2021
- The implementation of remote home monitoring models during the COVID-19 pandemic in EnglandeClinicalMedicine, 2021
- Service Innovation in Healthcare: A Systematic Literature ReviewLatin American Business Review, 2020
- Large‐System Transformation in Health Care: A Realist ReviewThe Milbank Quarterly, 2012
- Path Dependency, or Why History Makes It Difficult but Not Impossible to Reform Health Care Systems in a Big WayJournal of Public Policy, 1994