A Deep Deterministic Policy Gradient Approach to Medication Dosing and Surveillance in the ICU
Authors:
- 1 July 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2018, 4927-4931
Abstract
Medication dosing in a critical care environment is a complex task that involves close monitoring of relevant physiologic and laboratory biomarkers and corresponding sequential adjustment of the prescribed dose. Misdosing of medications with narrow therapeutic windows (such as intravenous [IV] heparin) can result in preventable adverse events, decrease quality of care and increase cost. Therefore, a robust recommendation system can help clinicians by providing individualized dosing suggestions or corrections to existing protocols. We present a clinician-in-the-loop framework for adjusting IV heparin dose using deep reinforcement learning (RL). Our main objectives were to learn a new IV heparin dosing policy based on the multi-dimensional features of patients, and evaluate the effectiveness of the learned policy in the presence of other confounding factors that may contribute to heparin-related side effects. The data used in the experiments included 2598 intensive care patients from the publicly available MIMIC database and 2310 patients from the Emory University clinical data warehouse. Experimental results suggested that the distance from RL policy had a statistically significant association with anticoagulant complications (p<; 0.05), after adjusting for the effects of confounding factors.Keywords
This publication has 7 references indexed in Scilit:
- Optimal medication dosing from suboptimal clinical examples: A deep reinforcement learning approach2016
- Electronic health records to facilitate clinical researchClinical Research in Cardiology, 2016
- MIMIC-III, a freely accessible critical care databaseScientific Data, 2016
- A data-driven approach to optimized medication dosing: a focus on heparinIntensive Care Medicine, 2014
- Healthcare outcomes assessed with observational study designs compared with those assessed in randomized trialsCochrane Database of Systematic Reviews, 2014
- The Propensity Score with Continuous Treatments2004
- Reinforcement Learning: A SurveyJournal of Artificial Intelligence Research, 1996