A Hierarchical Multimodal Framework for Sedation Monitoring in ICU Patients
- 1 June 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Biomedical Engineering
- Vol. 73 (6) , 2227-2236
Abstract
In the intensive care unit (ICU), monitoring sedation levels is crucial. Clinicians often rely on intermittent behavioral scales like the Richmond Agitation-Sedation Scale (RASS), which can be subjective and delay timely interventions. While electroencephalogram (EEG) offers a continuous and non-invasive alternative, but the complexity of consciousness renders a unimodal signal insufficient for comprehensive representation. To address these challenges, we propose a novel multimodal deep learning framework, Hierarchical Multimodal Fusion with Dynamic Correction (HMDC), that synergistically integrates EEG with peripheral physiological signals including blood pressure, heart rate, and oxygen saturation. The architecture features a dual-stream pathway to process both raw temporal EEG data and its spectral features from spectrograms. These neural representations are then intelligently fused and refined by a Dynamic Correction Module using a confidence-weighting mechanism. The model was developed and validated on a dataset comprising 2,880 labeled RASS assessments from 105 ICU patients, with scores ranging from −5 (comatose) to +1 (restless). The HMDC framework achieved a classification accuracy of 83.8%, significantly outperforming unimodal and simpler fusion baselines. By providing a temporally precise and physiologically grounded sedation assessment, this integrative approach establishes a robust correlation between multimodal signal patterns and clinical states, offering clinicians a unified tool for optimizing sedative titration and potentially minimizing delirium risks.Keywords
Funding Information
- National Natural Science Foundation of China (62373073)
- Fundamental Research Funds for the Central Universities (DUT25YG111)
- Dalian Medical Key Specialty (2022ZZ265)
- Program of Key Clinical Specialties in Liaoning Province (2023SZ013)
This publication has 43 references indexed in Scilit:
- Measuring the dynamic balance of integration and segregation underlying consciousness, anesthesia, and sleep in humansNature Communications, 2024
- Anesthesia and the neurobiology of consciousnessNeuron, 2024
- Fractional Dynamics Foster Deep Learning of COPD Stage PredictionAdvanced Science, 2023
- Delirium in critical illness: clinical manifestations, outcomes, and managementIntensive Care Medicine, 2021
- Automated tracking of level of consciousness and delirium in critical illness using deep learningnpj Digital Medicine, 2019
- Clinical phenotypes of delirium during critical illness and severity of subsequent long-term cognitive impairment: a prospective cohort studyThe Lancet Respiratory Medicine, 2018
- What is an intensive care unit? A report of the task force of the World Federation of Societies of Intensive and Critical Care MedicineJournal of Critical Care, 2017
- Comfort and patient-centred care without excessive sedation: the eCASH conceptIntensive Care Medicine, 2016
- Sedation and delirium in the intensive care unitSurgery (Oxford), 2015
- ICU-Acquired Weakness and Recovery from Critical IllnessNew England Journal of Medicine, 2014