Transparent Early ICU Mortality Prediction with Clinical Transformer and Per-Case Modality Attribution
Preprint
Abstract
Early identification of intensive care patients at risk of in-hospital mortality enables timely intervention and efficient resource allocation. Despite high predictive performance, existing machine learning approaches lack transparency and robustness, limiting clinical adoption. We present a lightweight, transparent multimodal ensemble that fuses physiological time-series measurements with unstructured clinical notes from the first 48 hours of an ICU stay. A logistic regression model combines predictions from two modality-specific models: a bidirectional LSTM for vitals and a finetuned ClinicalModernBERT transformer for notes. This traceable architecture allows for multilevel interpretability: feature attributions within each modality and direct per-case modality attributions quantifying how vitals and notes influence each decision. On the MIMIC-III benchmark, our late-fusion ensemble improves discrimination over the best single model (AUPRC 0.565 vs. 0.526; AUROC 0.891 vs. 0.876) while maintaining well-calibrated predictions. The system remains robust through a calibrated fallback when a modality is missing. These results demonstrate competitive performance with reliable, auditable risk estimates and transparent, predictable operation, which together are crucial for clinical use.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- Advancing Anomaly Detection: Non-Semantic Financial Data Encoding With Large Language ModelsIEEE Access, 2025
- Large language models encode clinical knowledgeNature, 2023
- A manifesto on explainability for artificial intelligence in medicineArtificial Intelligence in Medicine, 2022
- Stop explaining black box machine learning models for high stakes decisions and use interpretable models insteadNature Machine Intelligence, 2019
- High-performance medicine: the convergence of human and artificial intelligenceNature Medicine, 2019
- Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)IEEE Access, 2018
- Scalable and accurate deep learning with electronic health recordsnpj Digital Medicine, 2018
- Recurrent Neural Networks for Multivariate Time Series with Missing ValuesScientific Reports, 2018
- Sepsis in European intensive care units: Results of the SOAP study*Critical Care Medicine, 2006
- A New Simplified Acute Physiology Score (SAPS II) Based on a European/North American Multicenter StudyJAMA, 1993