NCNadia Crellin

Nadia Crellin

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Nadia Crellin has a total of 79 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Implementing artificial intelligence in chest diagnostics for lung disease: A mixed-methods evaluation

    by Angus Ig Ramsay, Kevin Herbert, Rachel Lawrence, Chris Sherlaw-Johnson, Stuti Bagri, Nadia Crellin, Emma Dodsworth, Holly Elphinstone, Amanda Halliday, Joanne Lloyd, et al.

    Background: Artificial intelligence tools simulate aspects of human intelligence. Policy and research highlight artificial intelligence’s potential to support delivery of radiology pathways. In 2023, National Health Service (NHS) England invested £21M to deploy artificial intelligence diagnostic tools for chest X-ray and chest computed tomography in 66 NHS Trusts. Little is known about how artificial intelligence tools are implemented in practice, staff experience of these tools, and their effectiveness and cost. Objectives: Evaluate evidence on artificial intelligence tools within radiology internationally. Evaluate implementation of artificial intelligence for chest diagnostics in England. Investigate how effectiveness and cost-effectiveness of artificial intelligence for chest diagnostics can be measured. Methods: Ten-month mixed-methods study (rapid scoping review and empirical study comprising staff interviews, observations and documentary analysis). Findings were analysed using rapid assessment procedures, drawing on qualitative, quantitative and health economic approaches. Our evaluation was also designed to inform phase 2 of our study. Findings: The review included 114 articles on artificial intelligence use in radiology, internationally. Empirical work included 51 staff interviews, 57 observations and 166 documents from 10/11 of the networks and 6/66 trusts implementing artificial intelligence tools. Our review found evidence gaps, including real-world implementation of artificial intelligence tools; patient and carer experiences; impact on inequalities, sustainability and wider systems; and cost-effectiveness. Artificial intelligence for chest diagnostics was implemented in various ways, with different aims, pathways and approaches. Implementation takes time due to multiple activities related to planning, procurement, preparation for deployment, monitoring and evaluation. These tasks – technical and social – required time and resource, including a wide range of stakeholders and expertise. As of November 2024, 24/66 trusts had implemented artificial intelligence tools in practice. Implementation barriers included time, resources, challenges navigating processes and adapting these to local contexts. Facilitators included stakeholder engagement and support. Network and trust ability to evaluate service impact was influenced by factors such as data availability, data linkage, resources and capacity. Factors varied across implementation stages. Our findings indicated multiple data sources that may support measurement of effectiveness and cost-effectiveness within the English National Health Service. However, limitations to data availability need to be addressed. Limitations: Our rapid timeline meant we could not interview patients, carers, and several staff groups at trust and national levels. Delayed deployment meant we could not study implementation in practice or staff experiences. Future work: Should address real-world implementation, adaptation, and sustainability of artificial intelligence tools; impact of artificial intelligence on care, outcomes, and cost-effectiveness; and staff, patient, and carer experiences of artificial intelligence in practice. We will study these issues in phase 2 of our evaluation. Conclusions: Artificial intelligence tools may support effective, efficient chest diagnostics services. However, several factors should be considered when implementing and monitoring artificial intelligence tools. Implementation and monitoring may be improved through allowing sufficient time for procurement and preparation for deployment or extending capacity to speed completion of these tasks, early and ongoing stakeholder engagement, sufficient resourcing, dedicated expertise and clinical champions, simplifying governance processes, and improving data capacity. Parallels with learning from implementing other innovations suggests that artificial intelligence tools may not offer straightforward solutions anticipated by services and policy-makers. Funding: This article presents independent research funded by the National Institute for Health and Care Research (NIHR) Health and Social Care Delivery Research programme as award number NIHR167339.


  • Open Access

    Staff experiences of implementing patient-initiated follow-up (PIFU) in the NHS in England: findings from a rapid qualitative evaluation

    by Cyril Lobont, Rachel Hutchings, Stuti Bagri, Nadia Crellin, Theo Georghiou, Stephanie Kumpunen, Jenny Negus, Pei Li Ng, Camille Oung, Angus I G Ramsay, et al.

    Objectives: The NHS in England has introduced various innovations to keep up with the growing demand for elective care, one of which is patient-initiated follow-up (PIFU). This evaluation sought to understand staff experiences of implementing PIFU. Methods: We conducted a rapid qualitative service evaluation between June 2022 and July 2023, based on semi-structured interviews (n = 36) with operational/managerial and clinical NHS staff from five English NHS Trusts, and an online workshop with 21 additional members of staff from the English NHS. We drew on the Non-adoption, Abandonment, Scale-up, Spread and Sustainability (NASSS) framework to structure qualitative data collection and analysis and to generate new insights into the adoption of the innovation of PIFU. Results: We found that implementation of PIFU affected staff roles, workload, and job satisfaction. Levels of PIFU uptake, and experience with similar models, affected the extent to which participants experienced the impact of PIFU. How PIFU was implemented varied. Some staff saw changes in their role because of new administrative demands, safety-netting procedures (such as proactive measures by specialty teams to mitigate the risk of patients not initiating appointments when necessary), and selection of suitable patients. PIFU was felt by some staff to increase, and by others to decrease, workload. PIFU affected intensity of work, interrelated with other factors such as the size of waiting lists, and conditions experienced by patients. Whether staff were satisfied with PIFU related to its impact on their role and workload. Satisfaction was also affected by whether staff believed PIFU delivered benefits for patients, and by the aims they felt were driving rollout. Conclusion: PIFU can significantly affect the experiences of staff and change staff roles and workload. However, the impact of PIFU is not uniform. Staff perspectives on PIFU from all parts of the health system should be better understood and considered during pathway design.


  • Open Access

    Implementation, Experiences, Impact, and Costs of Artificial Intelligence in Chest Diagnostics: Protocol for a Mixed Methods Evaluation

    by Angus I G Ramsay, Chris Sherlaw-Johnson, Kevin Herbert, Stuti Bagri, Malina Bodea, Nadia Crellin, Holly Elphinstone, Amanda Halliday, Nina Hemmings, Rachel Lawrence, et al.

    Background: The ability to perform complex tasks has seen artificial intelligence (AI) used to support radiology in clinical settings, including lung cancer detection and diagnosis. Evidence suggests that AI can contribute to accurate diagnosis, reduce errors, and improve efficiency. The National Health Service England (NHSE)–funded Artificial Intelligence Diagnostic Fund (AIDF) is currently supporting 12 National Health Service (NHS) networks to implement AI for chest diagnostic imaging. There is, however, limited evidence on real-world AI implementation and use, including staff, patient, and caregiver experience, and costs and cost-effectiveness. A National Institute for Health and Care Research Rapid Service Evaluation Team Phase 1 evaluation provided insights into the early implementation of these tools and developed a framework for monitoring and evaluation of AI tools for chest diagnostic imaging in practice. Objective: This mixed methods evaluation of AI tools for chest diagnostic imaging aims to address previous research gaps by exploring the implementation of AI tools for chest diagnostic imaging, the impact and costs of implementing these service models, and the experiences of patients, caregivers, and staff. Methods: This study will be a mixed method evaluation of implementation, experiences, impact, and costs of AI for chest diagnostic imaging in NHS services in England, with the evaluation informed by the Major System Change Framework. Trust-level case studies (3 in-depth and up to 9 light-touch) will be performed, including staff member, patient, and caregiver; NHSE AIDF team interviews; meeting observations; and analysis of key relevant documentation. Qualitative data will be analyzed using Rapid Assessment Procedures and inductive thematic analysis, supplemented by in-depth deductive thematic analysis. Data from case study sites and other relevant sources will be used to assess outcomes at the other sites and for comparators. A pragmatic economic model of the chest diagnostic imaging pathway will be developed to estimate key costs and resource use associated with AI tool deployment. Together with input from national stakeholders and staff workshops, the study findings will then be finalized for reporting. Results: As of September 2025, trust-level research and development approvals with participating sites are complete, and data collection has commenced. Results are expected to be reported by the end of February 2026. Conclusions: The study will provide new insights into the facilitators and barriers to the adoption of AI technology in health care and the perceptions of both the general public and health care staff on its use. It will also inform best practices in approaches for service performance evaluation, for the implementation of AI into existing care pathways, and for the development of models to best support evidence-based decision-making. It will thus establish a framework upon which the greatest benefits of the use of AI in health care can be realized. International Registered Report Identifier (IRRID): DERR1-10.2196/81421


  • Open Access

    Implementation, Experiences, Impact, and Costs of Artificial Intelligence in Chest Diagnostics: Protocol for a Mixed Methods Evaluation (Preprint)

    by Angus I G Ramsay, Chris Sherlaw-Johnson, Kevin Herbert, Stuti Bagri, Malina Bodea, Nadia Crellin, Holly Elphinstone, Amanda Halliday, Nina Hemmings, Rachel Lawrence, et al.

    Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author). Background: The ability to perform complex tasks has seen artificial intelligence (AI) used to support radiology in clinical settings, including lung cancer detection and diagnosis. Evidence suggests that AI can contribute to accurate diagnosis, reduce errors, and improve efficiency. The National Health Service England (NHSE)–funded Artificial Intelligence Diagnostic Fund (AIDF) is currently supporting 12 National Health Service (NHS) networks to implement AI for chest diagnostic imaging. There is, however, limited evidence on real-world AI implementation and use, including staff, patient, and caregiver experience, and costs and cost-effectiveness. A National Institute for Health and Care Research Rapid Service Evaluation Team Phase 1 evaluation provided insights into the early implementation of these tools and developed a framework for monitoring and evaluation of AI tools for chest diagnostic imaging in practice. Objective: This mixed methods evaluation of AI tools for chest diagnostic imaging aims to address previous research gaps by exploring the implementation of AI tools for chest diagnostic imaging, the impact and costs of implementing these service models, and the experiences of patients, caregivers, and staff. Methods: This study will be a mixed method evaluation of implementation, experiences, impact, and costs of AI for chest diagnostic imaging in NHS services in England, with the evaluation informed by the Major System Change Framework. Trust-level case studies (3 in-depth and up to 9 light-touch) will be performed, including staff member, patient, and caregiver; NHSE AIDF team interviews; meeting observations; and analysis of key relevant documentation. Qualitative data will be analyzed using Rapid Assessment Procedures and inductive thematic analysis, supplemented by in-depth deductive thematic analysis. Data from case study sites and other relevant sources will be used to assess outcomes at the other sites and for comparators. A pragmatic economic model of the chest diagnostic imaging pathway will be developed to estimate key costs and resource use associated with AI tool deployment. Together with input from national stakeholders and staff workshops, the study findings will then be finalized for reporting. Results: As of September 2025, trust-level research and development approvals with participating sites are complete, and data collection has commenced. Results are expected to be reported by the end of February 2026. Conclusions: The study will provide new insights into the facilitators and barriers to the adoption of AI technology in health care and the perceptions of both the general public and health care staff on its use. It will also inform best practices in approaches for service performance evaluation, for the implementation of AI into existing care pathways, and for the development of models to best support evidence-based decision-making. It will thus establish a framework upon which the greatest benefits of the use of AI in health care can be realized. Trial Registration:

  • Open Access

    Delivering virtual wards at scale in LMICs: What can we learn from a qualitative exploration of a national virtual ward programme in the UK (Preprint)

    by Ian Litchfield, Holly Walton, Nadia Crellin, Naomi Fulop, Chris Sherlaw-Johnson, Manbinder Sidhu, Joanne Ellins

    BACKGROUND As the potential of virtual wards to offer safe cost-effective care at distance is becoming more widely understood, their international utilisation is growing for a range of conditions, despite the lack of robust, policy level principles for their design and delivery. Policymakers, commissioners and service leads in high-income-countries have the benefit of learning from numerous if localised initiatives, for those in low-and middle-income countries there are few previous examples to draw upon. However, with growing evidence that the key challenges of providing effective and equitable digital health are shared by health systems across the globe, it is possible that important lessons for low-income countries can be learnt from the experiences of those delivering virtual ward programmes in high-income countries. OBJECTIVE To collate the experiences of policymakers, clinical innovators and service providers of delivering a national virtual ward programme in the UK and place these findings in the context of low-and-middle-income-countries specifically for the purpose of providing practicable learning for those in low-and-middle-income settings. METHODS A directed content analysis using qualitative data collected from interviews with staff involved in developing, leading and delivering a national virtual ward programme (n=58) was used to populate the domains of the Non-adoption, Abandonment, and challenges to the Scale-up, Spread, and Sustainability of technologies for health and social care (NASSS) framework. RESULTS The NASSS framework provided transferable learning for those wishing to deliver VWs at scale in Low-and-middle-income-countries across its seven domains: Condition, the importance of having a process for accommodating new clinical evidence into the existing referral and treatment criteria; Technology, the need for robust and consistent supply lines, and greater provider engagement in digital procurement; Value proposition the benefits of unified (central) messaging on need and benefit to facilitate patient understanding and organisational buy-in; Adopters the need to understand the digital capabilities of patients and their carers, and the impact of remote working, especially on co-opted, inexperienced or untrained staff; Organisation, the value of prior experience of delivering similar services and existing collaborative inter-organisational partnerships; Wider system, the importance of national policies being structured to accommodate regional priorities and of leadership cultures that share best practice; Finally in Embedding over time the need to integrate systematic evaluation to inform iterative improvement incorporating, if not driven by, patient experience. CONCLUSIONS If virtual wards in low-and-middle-income-countries are to be successfully deployed at scale they need to overcome several challenges relating to the interaction of infrastructure, technology, patients, providers, and organisations as exemplified by the experience of implementing the national virtual ward programme in the United Kingdom. Building on our findings we have developed a series of questions to inform current and future policy design for national virtual ward programmes in low-and-middle-income-countries.

  • Open Access

    Applying the major system change framework to evaluate implementation of rapid healthcare system change: a case study of COVID-19 remote home monitoring services

    by Holly Walton, Nadia Crellin, Ian Litchfield, Chris Sherlaw-Johnson, Theo Georghiou, Efthalia Massou, Manbinder Sidhu, Sonila M. Tomini, Lauren Herlitz, Jo Ellins, et al.

    A framework to evaluate implementation of Major System Change (MSC) in healthcare has been developed and applied to implementation of longer-term system changes. This was the first study to apply the five domains of the MSC framework to rapid healthcare system change. We aimed to: i) evaluate implementation of rapid MSC, using England COVID-19 remote home monitoring services as a case study and ii) consider whether and how the MSC framework can be applied to rapid MSC. A mixed-methods rapid evaluation in England, across 28 primary and secondary healthcare sites (October 2020-November 2021; data collection: 4 months). We conducted 126 interviews (5 national leads, 59 staff, 62 patients/carers) and surveyed staff (n = 292) and patients/carers (n = 1069). Service providers completed cost surveys. Aggregated and patient-level national datasets were used to explore enrolment, service use and clinical outcomes. The MSC framework was applied retrospectively. Qualitative data were analysed thematically to explore key themes within each MSC framework domain. Descriptive statistics and multivariate analyses were used to analyse experience, costs, service use and clinical outcomes. Decision to change/Decision on model: Service development happened concurrently: i) early local development motivated by urgent clinical need, ii) national rollout using standard operating procedures, and iii) local implementation and adaptation. Implementation approach: Services were tailored to local needs to consider patient, staff, organisational and resource factors. Implementation outcomes: Patient enrolment was low (59% services <10%). Service models and implementation approaches varied substantially. Intervention outcomes: No associations found between services and clinical outcomes. Patient and staff experiences were generally positive. However, barriers to delivery and engagement were found; with some groups finding it harder to engage. Low enrolment rates and substantial variation due to tailoring services to local contexts meant it was not possible to conclusively determine service effectiveness. Process outcomes indicated areas of improvement. The MSC framework can be used to analyse rapid MSC. Implementation and factors influencing implementation may differ to non-rapid contexts (e.g. less uniformity, more tailoring). Our mixed-methods approach could inform future evaluations of large-scale rapid and non-rapid MSC in a range of conditions and services internationally.


  • Open Access

    Investigating innovations in outpatient services: a mixed-methods rapid evaluation

    by Chris Sherlaw-Johnson, Theo Georghiou, Sarah Reed, Rachel Hutchings, John Appleby, Stuti Bagri, Nadia Crellin, Stephanie Kumpunen, Cyril Lobont, Jenny Negus, et al.

    Background: Within outpatient services, a broad range of innovations are being pursued to better manage care and reduce unnecessary appointments. One of the least-studied innovations is Patient-Initiated Follow-Up, which allows patients to book appointments if and when they need them, rather than follow a standard schedule. Objectives: To use routine national hospital data to identify innovations in outpatient services implemented, in recent years, within the National Health Service in England. To carry out a rapid mixed-methods evaluation of the implementation and impact of Patient-Initiated Follow-Up. Methods: The project was carried out in four sequential workstreams: (1) a rapid scoping review of outpatient innovations; (2) the application of indicator saturation methodology for scanning national patient-level data to identify potentially successful local interventions; (3) interviews with hospitals identified in workstream 2; and (4) a rapid mixed-methods evaluation of Patient-Initiated Follow-Up. The evaluation of Patient-Initiated Follow-Up comprised an evidence review, interviews with 36 clinical and operational staff at 5 National Health Service acute trusts, a workshop with staff from 13 National Health Service acute trusts, interviews with four patients, analysis of national and local data, and development of an evaluation guide. Results: Using indicator saturation, we identified nine services with notable changes in follow-up to first attendance ratios. Of three sites interviewed, two queried the data findings and one attributed the change to a clinical assessment service. Models of Patient-Initiated Follow-Up varied widely between hospital and clinical specialty, with a significant degree of variation in the approach to patient selection, patient monitoring and discharge. The success of implementation was dependent on several factors, for example, clinical condition, staff capacity and information technology systems. From the analysis of national data, we found evidence of an association between greater use of Patient-Initiated Follow-Up and a lower frequency of outpatient attendance within 15 out of 29 specialties and higher frequency of outpatient attendance within 7 specialties. Four specialties had less frequent emergency department visits associated with increasing Patient-Initiated Follow-Up rates. Patient-Initiated Follow-Up was viewed by staff and the few patients we interviewed as a positive intervention, although there was varied impact on individual staff roles and workload. It is important that sites and services undertake their own evaluations of Patient-Initiated Follow-Up. To this end we have developed an evaluation guide to support trusts with data collection and methods. Limitations: The Patient-Initiated Follow-Up evaluation was affected by a lack of patient-level data showing who is on a Patient-Initiated Follow-Up pathway. Engagement with local services was also challenging, given the pressures facing sites and staff. Patient recruitment was low, which affected the ability to understand experiences of patients directly. Conclusions: The study provides useful insights into the evolving national outpatient transformation policy and for local practice. Patient-Initiated Follow-Up is often perceived as a positive intervention for staff and patients, but the impact on individual outcomes, health inequalities, wider patient experience, workload and capacity is still uncertain. Future research: Further research should include patient-level analysis to determine clinical outcomes for individual patients on Patient-Initiated Follow-Up and health inequalities, and more extensive investigation of patient experiences. Study registration: This study is registered with the Research Registry (UIN: researchregistry8864). Funding: This award was funded by the National Institute for Health and Care Research (NIHR) Health and Social Care Delivery Research programme (NIHR award ref: 16/138/17) and is published in full in Health and Social Care Delivery Research; Vol. 12, No. 38. See the NIHR Funding and Awards website for further award information.


  • Open Access

    Patient Characteristics Associated With Disparities in Engagement With and Experience of COVID‐19 Remote Home Monitoring Services: A Mixed‐Methods Evaluation

    by Nadia E. Crellin, Lauren Herlitz, Manbinder S. Sidhu, Jo Ellins, Theo Georghiou, Ian Litchfield, Efthalia Massou, Pei Li Ng, Chris Sherlaw‐Johnson, Sonila M. Tomini, et al.

    Introduction: The adoption of remote healthcare methods has been accelerated by the COVID‐19 pandemic, but evidence suggests that some patients need additional support to engage remotely, potentially increasing health disparities if needs are not met. This study of COVID‐19 remote home monitoring services across England explores experiences of and engagement with the service across different patient groups.Methods: This was a mixed‐methods study with survey and interview data collected from 28 services across England between February and June 2021. Surveys were conducted with staff and patients and carers receiving the service. Interviews with staff service leads, patients and carers were conducted in 17 sites. Quantitative data were analysed using univariate and multivariate methods, and qualitative data were analysed using thematic analysis.Findings: Survey responses were received from 292 staff and 1069 patients and carers. Twenty‐three staff service leads, 59 patients and 3 carers were interviewed. Many service leads reported that they had considered inclusivity when adapting the service for their local population; strategies included widening the eligibility criteria, prioritising vulnerable groups and creating referral pathways. However, disparities were reported across patient groups in their experiences and engagement. Older patients reported the service to be less helpful (p = 0.004), were more likely to report a problem (p < 0.001) and had more difficulty in understanding information (p = 0.005). Health status (p = 0.004), ethnicity (p < 0.001), gender (p < 0.001) and employment (p = 0.007) were associated with differential engagement with monitoring, and minority ethnic groups reported more difficulty understanding service information (p = 0.001). Qualitative data found illness severity to be an important factor in the support required, and patients' living situation and social network affected whether they found the service reassuring.Conclusion: Addressing health disparities must be a key focus in the design and delivery of remote care. Services should be tailored to match the needs of their local population, encourage access through collaboration and referral pathways with other services and monitor their inclusiveness. Involving patients and staff in service design can illuminate the diversity of patients' needs and experiences of care.Patient or Public Contribution: The study team met with service user and public members of the BRACE PPI group and patient representatives from RSET in a series of workshops. Workshops informed study design, data collection tools, data interpretation and dissemination activities. Study documents (such as consent forms, topic guides, surveys and information sheets) were reviewed by PPI members; patient surveys and interview guides were piloted, and members also commented on the manuscript.


  • Open Access

    Patient and staff experiences of using technology-enabled and analogue models of remote home monitoring for COVID-19 in England: A mixed-method evaluation

    by Lauren Herlitz, Nadia Crellin, Cecilia Vindrola-Padros, Jo Ellins, Theo Georghiou, Ian Litchfield, Efthalia Massou, Pei Li Ng, Chris Sherlaw-Johnson, Manbinder S. Sidhu, et al.


  • Open Access

    A rapid mixed-methods evaluation of remote home monitoring models during the COVID-19 pandemic in England

    by Naomi J Fulop, Holly Walton, Nadia Crellin, Theo Georghiou, Lauren Herlitz, Ian Litchfield, Efthalia Massou, Chris Sherlaw-Johnson, Manbinder Sidhu, Sonila M Tomini, et al.

    Background: Remote home monitoring services were developed and implemented for patients with COVID-19 during the pandemic. Patients monitored blood oxygen saturation and other readings (e.g. temperature) at home and were escalated as necessary. Objective: To evaluate effectiveness, costs, implementation, and staff and patient experiences (including disparities and mode) of COVID-19 remote home monitoring services in England during the COVID-19 pandemic (waves 1 and 2). Methods: A rapid mixed-methods evaluation, conducted in two phases. Phase 1 (July–August 2020) comprised a rapid systematic review, implementation and economic analysis study (in eight sites). Phase 2 (January–June 2021) comprised a large-scale, multisite, mixed-methods study of effectiveness, costs, implementation and patient/staff experience, using national data sets, surveys (28 sites) and interviews (17 sites). Results: Phase 1 Findings from the review and empirical study indicated that these services have been implemented worldwide and vary substantially. Empirical findings highlighted that communication, appropriate information and multiple modes of monitoring facilitated implementation; barriers included unclear referral processes, workforce availability and lack of administrative support. Phase 2 We received surveys from 292 staff (39% response rate) and 1069 patients/carers (18% response rate). We conducted interviews with 58 staff, 62 patients/carers and 5 national leads. Despite national roll-out, enrolment to services was lower than expected (average enrolment across 37 clinical commissioning groups judged to have completed data was 8.7%). There was large variability in implementation of services, influenced by patient (e.g. local population needs), workforce (e.g. workload), organisational (e.g. collaboration) and resource (e.g. software) factors. We found that for every 10% increase in enrolment to the programme, mortality was reduced by 2% (95% confidence interval: 4% reduction to 1% increase), admissions increased by 3% (−1% to 7%), in-hospital mortality fell by 3% (−8% to 3%) and lengths of stay increased by 1.8% (−1.2% to 4.9%). None of these results are statistically significant. We found slightly longer hospital lengths of stay associated with virtual ward services (adjusted incidence rate ratio 1.05, 95% confidence interval 1.01 to 1.09), and no statistically significant impact on subsequent COVID-19 readmissions (adjusted odds ratio 0.95, 95% confidence interval 0.89 to 1.02). Low patient enrolment rates and incomplete data may have affected chances of detecting possible impact. The mean running cost per patient varied for different types of service and mode; and was driven by the number and grade of staff. Staff, patients and carers generally reported positive experiences of services. Services were easy to deliver but staff needed additional training. Staff knowledge/confidence, NHS resources/workload, dynamics between multidisciplinary team members and patients’ engagement with the service (e.g. using the oximeter to record and submit readings) influenced delivery. Patients and carers felt services and human contact received reassured them and were easy to engage with. Engagement was conditional on patient, support, resource and service factors. Many sites designed services to suit the needs of their local population. Despite adaptations, disparities were reported across some patient groups. For example, older adults and patients from ethnic minorities reported more difficulties engaging with the service. Tech-enabled models helped to manage large patient groups but did not completely replace phone calls. Limitations: Limitations included data completeness, inability to link data on service use to outcomes at a patient level, low survey response rates and under-representation of some patient groups. Future work: Further research should consider the long-term impact and cost-effectiveness of these services and the appropriateness of different models for different groups of patients. Conclusions: We were not able to find quantitative evidence that COVID-19 remote home monitoring services have been effective. However, low enrolment rates, incomplete data and varied implementation reduced our chances of detecting any impact that may have existed. While services were viewed positively by staff and patients, barriers to implementation, delivery and engagement should be considered. Study registration: This study is registered with the ISRCTN (14962466). Funding: This project was funded by the National Institute for Health and Care Research (NIHR) Health and Social Care Delivery Research programme (RSET: 16/138/17; BRACE: 16/138/31) and NHSEI and will be published in full in Health and Social Care Delivery Research; Vol. 11, No. 13. See the NIHR Journals Library website for further project information. The views expressed in this publication are those of the authors and not necessarily those of the National Institute for Health and Care Research or the Department of Health and Social Care.