Development and validation of a model that uses enhanced administrative data to predict mortality in patients with sepsis
- 1 November 2011
- journal article
- research article
- Published by Wolters Kluwer Health in Critical Care Medicine
- Vol. 39 (11) , 2425-2430
Abstract
Objective: We aimed to determine whether a sepsis risk-adjustment model that uses only administrative data could be used when other intensive care unit risk-adjustment methods are unavailable. Design: Cohort study with development and validation cohorts. Patients: The development cohort included 166,931 patients at 309 hospitals that cared for at least 100 patients with sepsis between 2004 and 2006. The validation cohort included 357 adult sepsis patients who were enrolled in Project IMPACT, 2002–2009. Measurements and Main Results: We developed a multilevel mixed-effects logistic regression model to predict mortality at the patient level. Predictors included patient demographics (age, sex, race, insurance type), site and source of sepsis, presence of 25 individual comorbidities, treatment (within the first 2 days of hospitalization) with mechanical ventilation and/or vasopressors, and/or admission to the intensive care unit (within 2 days of hospitalization). We validated this model in 357 sepsis patients who were admitted to the intensive care unit at a single academic medical center and who had a valid Acute Physiology and Chronic Health Evaluation II score, a valid Simplified Acute Physiology Score II, and a valid Mortality Probability Model III score. Overall, 33,192 patients (19.9%) died in the hospital. In the development cohort, the predicted mortality ranged from 0.002 to 0.938 with a mean of 0.199. The model's area under the receiver operating characteristic curve was 0.78. In the validation cohort, all models had modest discriminatory ability and the areas under the receiver operating characteristic curves of all models were statistically similar (Acute Physiology and Chronic Health Evaluation II, 0.71; Simplified Acute Physiology Score II, 0.74; Mortality Probability Model III, 0.69; administrative model, 0.69; p value that the areas under the receiver operating characteristic curves are different, .35). The Hosmer-Lemeshow statistic was significant (p < .01) for Acute Physiology and Chronic Health Evaluation II, Simplified Acute Physiology Score II, and Mortality Probability Model III but was nonsignificant (p = .11) for the administrative model. Conclusions: A sepsis mortality model using detailed administrative data has discrimination similar to and calibration superior to those of existing severity scores that require chart review. This model may be a useful alternative method of severity adjustment for benchmarking purposes or for conducting large, retrospective epidemiologic studies of sepsis patients.Keywords
This publication has 32 references indexed in Scilit:
- Variation in ICU Risk-Adjusted MortalityChest, 2008
- Automated intensive care unit risk adjustment: Results from a National Veterans Affairs studyCritical Care Medicine, 2003
- The use of benchmarking to identify top performing critical care units: A preliminary assessment of their policies and practicesJournal of Critical Care, 2003
- The Epidemiology of Sepsis in the United States from 1979 through 2000New England Journal of Medicine, 2003
- Rating the quality of intensive care units: Is it a function of the intensive care unit scoring system?*Critical Care Medicine, 2002
- Identifying quality outliers in a large, multiple-institution database by using customized versions of the Simplified Acute Physiology Score II and the Mortality Probability Model II0*Critical Care Medicine, 2002
- Epidemiology of severe sepsis in the United States: Analysis of incidence, outcome, and associated costs of careCritical Care Medicine, 2001
- The Department of Veterans Affairs' NSQIPAnnals of Surgery, 1998
- A New Simplified Acute Physiology Score (SAPS II) Based on a European/North American Multicenter StudyJAMA, 1993
- APACHE IICritical Care Medicine, 1985