Implementation, Experiences, Impact, and Costs of Artificial Intelligence in Chest Diagnostics: Protocol for a Mixed Methods Evaluation (Preprint)
Authors:
- Angus I G RamsayARAngus I G Ramsay
- Chris Sherlaw-JohnsonCSChris Sherlaw-Johnson
- Kevin HerbertKHKevin Herbert
- Stuti BagriSBStuti Bagri
- Malina BodeaMBMalina Bodea
- Nadia CrellinNCNadia Crellin
- Holly ElphinstoneHEHolly Elphinstone
- Amanda HallidayAHAmanda Halliday
- Nina HemmingsNHNina Hemmings
- Rachel LawrenceRLRachel Lawrence
- Cyril LobontCLCyril Lobont
- Pei Li NgPNPei Li Ng
Preprint
- 28 July 2025
- preprint
- Published by JMIR Publications Inc. in JMIR Preprints
Abstract
Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author). Background: The ability to perform complex tasks has seen artificial intelligence (AI) used to support radiology in clinical settings, including lung cancer detection and diagnosis. Evidence suggests that AI can contribute to accurate diagnosis, reduce errors, and improve efficiency. The National Health Service England (NHSE)–funded Artificial Intelligence Diagnostic Fund (AIDF) is currently supporting 12 National Health Service (NHS) networks to implement AI for chest diagnostic imaging. There is, however, limited evidence on real-world AI implementation and use, including staff, patient, and caregiver experience, and costs and cost-effectiveness. A National Institute for Health and Care Research Rapid Service Evaluation Team Phase 1 evaluation provided insights into the early implementation of these tools and developed a framework for monitoring and evaluation of AI tools for chest diagnostic imaging in practice. Objective: This mixed methods evaluation of AI tools for chest diagnostic imaging aims to address previous research gaps by exploring the implementation of AI tools for chest diagnostic imaging, the impact and costs of implementing these service models, and the experiences of patients, caregivers, and staff. Methods: This study will be a mixed method evaluation of implementation, experiences, impact, and costs of AI for chest diagnostic imaging in NHS services in England, with the evaluation informed by the Major System Change Framework. Trust-level case studies (3 in-depth and up to 9 light-touch) will be performed, including staff member, patient, and caregiver; NHSE AIDF team interviews; meeting observations; and analysis of key relevant documentation. Qualitative data will be analyzed using Rapid Assessment Procedures and inductive thematic analysis, supplemented by in-depth deductive thematic analysis. Data from case study sites and other relevant sources will be used to assess outcomes at the other sites and for comparators. A pragmatic economic model of the chest diagnostic imaging pathway will be developed to estimate key costs and resource use associated with AI tool deployment. Together with input from national stakeholders and staff workshops, the study findings will then be finalized for reporting. Results: As of September 2025, trust-level research and development approvals with participating sites are complete, and data collection has commenced. Results are expected to be reported by the end of February 2026. Conclusions: The study will provide new insights into the facilitators and barriers to the adoption of AI technology in health care and the perceptions of both the general public and health care staff on its use. It will also inform best practices in approaches for service performance evaluation, for the implementation of AI into existing care pathways, and for the development of models to best support evidence-based decision-making. It will thus establish a framework upon which the greatest benefits of the use of AI in health care can be realized. Trial Registration:Keywords
All Related Versions
- Published version: JMIR Research Protocols, 14 (1), e81421.
This publication has 31 references indexed in Scilit:
- Artificial intelligence for diagnostics in radiology practice: a rapid systematic scoping revieweClinicalMedicine, 2025
- Rapid mixed-method evaluation of implementing Artificial Intelligence in chest diagnostics for lung diseaseThe Royal College of Radiologists Open, 2025
- Early experiences of integrating an artificial intelligence-based diagnostic decision support system into radiology settings: a qualitative studyJournal of the American Medical Informatics Association, 2023
- Singapore radiographers' perceptions and expectations of artificial intelligence - A qualitative studyJournal of Medical Imaging and Radiation Sciences, 2022
- UK reporting radiographers’ perceptions of AI in radiographic image interpretation – Current perspectives and future developmentsRadiography, 2022
- Using thematic analysis in counselling and psychotherapy research: A critical reflectionCounselling and Psychotherapy Research, 2018
- Emergency presentation lung cancer: how far are we from the National Optimal Lung Cancer PathwayLung Cancer, 2018
- Iterative categorization (IC): a systematic technique for analysing qualitative dataAddiction, 2016
- Kinghorn, Dr George Robert, (born 17 Aug. 1949), Clinical Director, NIHR South Yorkshire Comprehensive Local Research Network, 2011–15; Consultant in Genitourinary Medicine, 1979–2015, and Clinical Director for Communicable Diseases, 1991–2010, Sheffield Teaching Hospitals NHS Foundation Trust; Hon. Professor of Genitourinary Medicine, University of Sheffield, 2006–152007
- Sanderson, Eric Fenton, (born 14 Oct. 1951), Chairman: MWB Group Holdings PLC (formerly Marylebone Warwick Balfour plc), 2005–12 (non-executive Director, 2002–12); Schroder UK Mid Cap Fund plc, since 2014 (non-executive Director, since 2011); Black Rock Greater Europe Investment Trust plc, since 2016 (non-executive Director, since 2013)2007