Development and Validation of the COVID-19 Hospitalized Patient Deterioration Index
Authors:
- Claudia NauCNClaudia Nau
- Rebecca ButlerRBRebecca Butler
- Cheng- Wei HuangCHCheng- Wei Huang
- Vang KhangVKVang Khang
- Aiyu ChenACAiyu Chen
- Beth CreekmurBCBeth Creekmur
- Benjamin BroderBBBenjamin Broder
- Christopher SubjectCSChristopher Subject
- Adam SharpASAdam Sharp
- Luis Moreta- SainzLSLuis Moreta- Sainz
- Joon ParkJPJoon Park
- Akshay ManekAMAkshay Manek
- 1 December 2023
- journal article
- research article
- Published by Clinical Care Targeted Communications Group, LLC in The American Journal of Managed Care
- Vol. 29 (12) , e365-e371
Abstract
Objectives: To develop a COVID-19–specific deterioration index for hospitalized patients: the COVID Hospitalized Patient Deterioration Index (COVID-HDI). This index builds on the proprietary Epic Deterioration Index, which was not developed for predicting respiratory deterioration events among patients with COVID-19. Study Design: A retrospective observational cohort was used to develop and validate the COVID-HDI model to predict respiratory deterioration or death among hospitalized patients with COVID-19. Deterioration events were defined as death or requiring high-flow oxygen, bilevel positive airway pressure, mechanical ventilation, or intensive-level care within 72 hours of run time. The sample included hospitalized patients with COVID-19 diagnoses or positive tests at Kaiser Permanente Southern California between May 3, 2020, and October 17, 2020. Methods: Machine learning models and 118 candidate predictors were used to generate benchmark performance. Logit regression with least absolute shrinkage estimator and selection operator and physician input were used to finalize the model. Split-sample cross-validation was used to train and test the model. Results: The area under the receiver operating curve was 0.83. COVID-HDI identifies patients at low risk (negative predictive value [NPV] > 98.5%) and borderline low risk (NPV > 95%) of an event. Of all patients, 74% were identified as being at low or borderline low risk at some point during their hospitalization and could be considered for discharge with or without home monitoring. A high-risk group with a positive predictive value of 48% included 12% of patients. Model performance remained high in a recent cohort of patients. Conclusions: COVID-HDI is a parsimonious, well-calibrated, and accurate model that may support clinical decision-making around discharge and escalation of care.Keywords
This publication has 19 references indexed in Scilit:
- A validated, real-time prediction model for favorable outcomes in hospitalized COVID-19 patientsnpj Digital Medicine, 2020
- Development and Validation of the Quick COVID-19 Severity Index: A Prognostic Tool for Early Clinical DecompensationAnnals of Emergency Medicine, 2020
- Prediction model and risk scores of ICU admission and mortality in COVID-19PLOS ONE, 2020
- Presenting Characteristics, Comorbidities, and Outcomes Among 5700 Patients Hospitalized With COVID-19 in the New York City AreaJAMA, 2020
- Clinical Characteristics of Coronavirus Disease 2019 in ChinaNew England Journal of Medicine, 2020
- Characteristics and Outcomes of 21 Critically Ill Patients With COVID-19 in Washington StateJAMA, 2020
- Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisalBMJ, 2020
- Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: a retrospective cohort studyThe Lancet, 2020
- Clinical features of patients infected with 2019 novel coronavirus in Wuhan, ChinaThe Lancet, 2020
- Sociodemographic Characteristics of Members of a Large, Integrated Health Care System: Comparison with US Census Bureau DataThe Permanente Journal, 2012