Predicting Prolonged Apnea During Nurse-Administered Procedural Sedation: Machine Learning Study
Open Access
- 5 October 2021
- journal article
- research article
- Published by JMIR Publications Inc. in JMIR Perioperative Medicine
- Vol. 4 (2) , e29200
Abstract
Background: Capnography is commonly used for nurse-administered procedural sedation. Distinguishing between capnography waveform abnormalities that signal the need for clinical intervention for an event and those that do not indicate the need for intervention is essential for the successful implementation of this technology into practice. It is possible that capnography alarm management may be improved by using machine learning to create a “smart alarm” that can alert clinicians to apneic events that are predicted to be prolonged. Objective: To determine the accuracy of machine learning models for predicting at the 15-second time point if apnea will be prolonged (ie, apnea that persists for >30 seconds). Methods: A secondary analysis of an observational study was conducted. We selected several candidate models to evaluate, including a random forest model, generalized linear model (logistic regression), least absolute shrinkage and selection operator regression, ridge regression, and the XGBoost model. Out-of-sample accuracy of the models was calculated using 10-fold cross-validation. The net benefit decision analytic measure was used to assist with deciding whether using the models in practice would lead to better outcomes on average than using the current default capnography alarm management strategies. The default strategies are the aggressive approach, in which an alarm is triggered after brief periods of apnea (typically 15 seconds) and the conservative approach, in which an alarm is triggered for only prolonged periods of apnea (typically >30 seconds). Results: A total of 384 apneic events longer than 15 seconds were observed in 61 of the 102 patients (59.8%) who participated in the observational study. Nearly half of the apneic events (180/384, 46.9%) were prolonged. The random forest model performed the best in terms of discrimination (area under the receiver operating characteristic curve 0.66) and calibration. The net benefit associated with the random forest model exceeded that associated with the aggressive strategy but was lower than that associated with the conservative strategy. Conclusions: Decision curve analysis indicated that using a random forest model would lead to a better outcome for capnography alarm management than using an aggressive strategy in which alarms are triggered after 15 seconds of apnea. The model would not be superior to the conservative strategy in which alarms are only triggered after 30 seconds.Keywords
All Related Versions
This publication has 29 references indexed in Scilit:
- Characteristics of and Predictors for Apnea and Clinical Interventions During Procedural SedationAnnals of Emergency Medicine, 2016
- Capnography for the Radiology and Imaging Nurse: A PrimerJournal of Radiology Nursing, 2016
- Capnography Monitoring During Procedural Sedation in Radiology and Imaging Settings: An Integrative ReviewJournal of Radiology Nursing, 2016
- A calibration hierarchy for risk models was defined: from utopia to empirical dataJournal of Clinical Epidemiology, 2016
- Net benefit approaches to the evaluation of prediction models, molecular markers, and diagnostic testsBMJ, 2016
- Redesigning Hospital Alarms for Patient SafetyJAMA, 2014
- Trends in nurse-administered procedural sedation and analgesia across cardiac catheterisation laboratories in Australia and New Zealand: Results of an electronic surveyAustralian Critical Care, 2014
- Clinical practice guidelines for nurse‐administered procedural sedation and analgesia in the cardiac catheterization laboratory: a modified Delphi studyJournal of Advanced Nursing, 2013
- Issues and challenges associated with nurse‐administered procedural sedation and analgesia in the cardiac catheterisation laboratory: a qualitative studyJournal of Clinical Nursing, 2013
- Decision Curve Analysis: A Novel Method for Evaluating Prediction ModelsMedical Decision Making, 2006