A simple real-time model for predicting acute kidney injury in hospitalized patients in the US: A descriptive modeling study
Open Access
- 15 July 2019
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS Medicine
- Vol. 16 (7) , e1002861
Abstract
Acute kidney injury (AKI) is an adverse event that carries significant morbidity. Given that interventions after AKI occurrence have poor performance, there is substantial interest in prediction of AKI prior to its diagnosis. However, integration of real-time prognostic modeling into the electronic health record (EHR) has been challenging, as complex models increase the risk of error and complicate deployment. Our goal in this study was to create an implementable predictive model to accurately predict AKI in hospitalized patients and could be easily integrated within an existing EHR system. We performed a retrospective analysis looking at data of 169,859 hospitalized adults admitted to one of three study hospitals in the United States (in New Haven and Bridgeport, Connecticut) from December 2012 to February 2016. Demographics, medical comorbidities, hospital procedures, medications, and laboratory data were used to develop a model to predict AKI within 24 hours of a given observation. Outcomes of AKI severity, requirement for renal replacement therapy, and mortality were also measured and predicted. Models were trained using discrete-time logistic regression in a subset of Hospital 1, internally validated in the remainder of Hospital 1, and externally validated in Hospital 2 and Hospital 3. Model performance was assessed via the area under the receiver-operator characteristic (ROC) curve (AUC). The training set cohort contained 60,701 patients, and the internal validation set contained 30,599 patients. External validation data sets contained 43,534 and 35,025 patients. Patients in the overall cohort were generally older (median age ranging from 61 to 68 across hospitals); 44%-49% were male, 16%-20% were black, and 23%-29% were admitted to surgical wards. In the training set and external validation set, 19.1% and 18.9% of patients, respectively, developed AKI. The full model, including all covariates, had good ability to predict imminent AKI for the validation set, sustained AKI, dialysis, and death with AUCs of 0.74 (95% CI 0.73-0.74), 0.77 (95% CI 0.76-0.78), 0.79 (95% CI 0.73-0.85), and 0.69 (95% CI 0.67-0.72), respectively. A simple model using only readily available, time-updated laboratory values had very similar predictive performance to the complete model. The main limitation of this study is that it is observational in nature; thus, we are unable to conclude a causal relationship between covariates and AKI and do not provide an optimal treatment strategy for those predicted to develop AKI. In this study, we observed that a simple model using readily available laboratory data could be developed to predict imminent AKI with good discrimination. This model may lend itself well to integration into the EHR without sacrificing the performance seen in more complex models.Keywords
Funding Information
- National Institutes of Health (R01DK113191)
- National Institutes of Health (R01HL128973)
- National Institutes of Health (R01HL139629)
This publication has 33 references indexed in Scilit:
- A Novel Tool for Reliable and Accurate Prediction of Renal Complications in Patients Undergoing Percutaneous Coronary InterventionJACC, 2013
- The prevention and handling of the missing dataKorean Journal of Anesthesiology, 2013
- Biomarkers for the prediction of acute kidney injury: a narrative review on current status and future challengesClinical Kidney Journal, 2012
- Summary of Recommendation StatementsKidney International Supplements, 2012
- Prediction Modeling Using EHR DataMedical Care, 2010
- Novel Biomarkers Early Predict the Severity of Acute Kidney Injury After Cardiac Surgery in AdultsThe Annals of Thoracic Surgery, 2009
- Multiple imputation for missing data in epidemiological and clinical research: potential and pitfallsBMJ, 2009
- Biomarkers of Acute Kidney InjuryAdvances in Chronic Kidney Disease, 2008
- Acute Kidney Injury, Mortality, Length of Stay, and Costs in Hospitalized PatientsJournal of the American Society of Nephrology, 2005
- Course of acute renal failure studied by a model of creatinine kineticsKidney International, 1985