Multi-Agent Learning for Precise and Collaborative Control of Anesthetics in TIVA
Open Access
- 23 December 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 30 (7) , 5761-5774
Abstract
Precise and collaborative control of multiple anesthetics in Total Intravenous Anesthesia (TIVA) is essential for ensuring patient safety and maintaining the target depth of anesthesia (DoA). However, existing automated anesthesia control methods often fail to effectively capture the complex synergistic interactions between anesthetics and lack adaptability to patient-specific physiological variability, thereby limiting their clinical applicability. To address these issues, we propose AnesMADRL, a novel Multi-Agent Deep Reinforcement Learning (MADRL)-based framework that leverages the Counterfactual Multi-Agent algorithm for effective credit assignment between agents controlling propofol and remifentanil, and adopts a continuous action space to enable fine-grained dose adjustments. Furthermore, AnesMADRL integrates comprehensive patient-specific physiological indicators and employs a random forest-based simulator to generate dynamic and diverse training environments. Experimental results show that AnesMADRL significantly outperforms baseline methods and human expertise in terms of anesthetic efficiency and total drug consumption. Relative to human expertise, AnesMADRL achieves roughly twofold efficiency while reducing total dose to about one-half, highlighting its potential to enhance patient safety and optimize clinical outcomes.Keywords
Funding Information
- Macao Polytechnic University – Research on Representation Learning in Decision Support for Medical Diagnosis (RP/FCA-11/2022)
This publication has 37 references indexed in Scilit:
- Model enhanced reinforcement learning to enable precision dosing: A theoretical case study with dosing of propofolCPT: Pharmacometrics & Systems Pharmacology, 2022
- Multi-agent deep reinforcement learning: a surveyArtificial Intelligence Review, 2021
- Intelligent automated drug administration and therapy: future of healthcareDrug Delivery and Translational Research, 2021
- A random forest guided tourTEST, 2016
- Automation of anaesthesia: a review on multivariable controlJournal of Clinical Monitoring and Computing, 2014
- Markov Decision Processes2013
- A randomized controlled trial demonstrates that a novel closed-loop propofol system performs better hypnosis control than manual administrationCanadian Journal of Anesthesia/Journal canadien d'anesthésie, 2010
- Machine Learning Techniques for Decision Support in AnesthesiaLecture Notes in Computer Science, 2007
- Markov games as a framework for multi-agent reinforcement learning1994
- Measuring the predictive performance of computer-controlled infusion pumpsJournal of Pharmacokinetics and Biopharmaceutics, 1992