Optimized Renal Replacement Therapy Decisions in Intensive Care: A Reinforcement Learning Approach
Authors:
Preprint
- 27 March 2025
- preprint
- Published by Springer Nature in Research Square
Abstract
Purpose Acute kidney injury (AKI) is highly prevalent in intensive care units (ICUs) and often requires renal replacement therapy (RRT). However, the optimal timing for initiating RRT remains controversial. The aim of this study was to develop a reinforcement learning (RL) model to support individualized RRT decision-making for critically ill AKI patients. Methods We trained and validated our RL model using ICU data from two cohorts: the publicly available MIMIC-IV database and a dataset from the Medical University of Vienna (MUW). Patients with AKI of stage I or higher were included, and those with chronic kidney disease or prior kidney transplantation were excluded. We extracted 88 features, employing weighted K-means clustering for state definition. A Q-learning–based RL approach was applied, with off-policy evaluation to assess the policy’s performance versus clinician decisions. Results In both the MIMIC and MUW cohorts, the RL model demonstrated a high level of concordance (up to 98.5%) with clinicians but exhibited superior performance on key metrics. Notably, the model identified a reproducible patient subgroup with greater illness severity for whom earlier or more frequent RRT could improve outcomes, suggesting a beneficial role for AI-driven decision support. Conclusions Our RL model provides dynamic, data-driven recommendations for initiating and ceasing RRT, closely aligning with clinical practice and identifying high-risk patients who may benefit from earlier intervention.Keywords
All Related Versions
This publication has 41 references indexed in Scilit:
- Acute kidney injury predicts mortality in very elderly critically-ill patientsEuropean Journal of Internal Medicine, 2024
- KDIGO 2024 Clinical Practice Guideline for the Evaluation and Management of Chronic Kidney DiseaseKidney International, 2024
- Impact of renal-replacement therapy strategies on outcomes for patients with chronic kidney disease: a secondary analysis of the STARRT-AKI trialIntensive Care Medicine, 2022
- Artificial intelligence–guided precision treatment of chronic kidney disease–mineral bone disorderCPT: Pharmacometrics & Systems Pharmacology, 2022
- Short- and long-term outcomes of intensive care patients with acute kidney diseaseeClinicalMedicine, 2022
- Effect of Early vs Delayed Initiation of Renal Replacement Therapy on Mortality in Critically Ill Patients With Acute Kidney InjuryJAMA, 2016
- Epidemiology of acute kidney injury in critically ill patients: the multinational AKI-EPI studyIntensive Care Medicine, 2015
- Matrix Analysis2012
- Q-learningMachine Learning, 1992
- Bleeding time in Uremia: A useful test to assess clinical bleedingAmerican Journal of Hematology, 1979