Effectiveness of an Artificial Intelligence–Enabled Intervention for Detecting Clinical Deterioration
Authors:
Top Cited Papers
Open Access
- 1 May 2024
- journal article
- research article
- Published by American Medical Association (AMA) in JAMA Internal Medicine
- Vol. 184 (5) , 557-562
Abstract
Importance: Inpatient clinical deterioration is associated with substantial morbidity and mortality but may be easily missed by clinicians. Early warning scores have been developed to alert clinicians to patients at high risk of clinical deterioration, but there is limited evidence for their effectiveness.Objective: To evaluate the effectiveness of an artificial intelligence deterioration model–enabled intervention to reduce the risk of escalations in care among hospitalized patients using a study design that facilitates stronger causal inference.Design, Setting, and Participants: This cohort study used a regression discontinuity design that controlled for confounding and was based on Epic Deterioration Index (EDI; Epic Systems Corporation) prediction model scores. Compared with other observational research, the regression discontinuity design facilitates causal analysis. Hospitalized adults were included from 4 general internal medicine units in 1 academic hospital from January 17, 2021, through November 16, 2022.Exposure: An artificial intelligence deterioration model–enabled intervention, consisting of alerts based on an EDI score threshold with an associated collaborative workflow among nurses and physicians.Main Outcomes and Measures: The primary outcome was escalations in care, including rapid response team activation, transfer to the intensive care unit, or cardiopulmonary arrest during hospitalization.Results: During the study, 9938 patients were admitted to 1 of the 4 units, with 963 patients (median [IQR] age, 76.1 [64.2-86.2] years; 498 males [52.3%]) included within the primary regression discontinuity analysis. The median (IQR) Elixhauser Comorbidity Index score in the primary analysis cohort was 10 (0-24). The intervention was associated with a −10.4–percentage point (95% CI, −20.1 to −0.8 percentage points; P = .03) absolute risk reduction in the primary outcome for patients at the EDI score threshold. There was no evidence of a discontinuity in measured confounders at the EDI score threshold.Conclusions and Relevance: Using a regression discontinuity design, this cohort study found that the implementation of an artificial intelligence deterioration model–enabled intervention was associated with a significantly decreased risk of escalations in care among inpatients. These results provide evidence for the effectiveness of this intervention and support its further expansion and testing in other care settings.Keywords
This publication has 14 references indexed in Scilit:
- Red Blood Cell Transfusion at a Hemoglobin Threshold of 7 g/dl in Critically Ill Patients: A Regression Discontinuity StudyAnnals of the American Thoracic Society, 2022
- Using AI to Empower Collaborative Team Workflows: Two Implementations for Advance Care Planning and Care EscalationNEJM Catalyst, 2022
- Evaluation of an intervention targeted with predictive analytics to prevent readmissions in an integrated health system: observational studyBMJ, 2021
- Algorithms for Prediction of Clinical Deterioration on the General Wards: A Scoping ReviewJournal of Hospital Medicine, 2021
- Association of Intravenous Radiocontrast With Kidney FunctionJAMA Internal Medicine, 2021
- Automated Identification of Adults at Risk for In-Hospital Clinical DeteriorationNew England Journal of Medicine, 2020
- Regression Discontinuity DesignJAMA, 2020
- Advancing Quality Improvement with Regression Discontinuity DesignsAnnals of the American Thoracic Society, 2018
- Regression discontinuity designs are underutilized in medicine, epidemiology, and public health: a review of current and best practiceJournal of Clinical Epidemiology, 2015
- Coding Algorithms for Defining Comorbidities in ICD-9-CM and ICD-10 Administrative DataMedical Care, 2005