Towards Reliable Prediction: A Bayesian Continual Learning Approach for Clinical Time-series Data
- 1 September 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. PP (21682194) , 1-14
Abstract
Deep learning models are increasingly used for making predictions based on clinical time series data, but model generalization remains a challenge. Continual learning approaches, which preserve representations while learning new distributions, are suitable for addressing this challenge. We propose Continual Bayesian Long Short Term Memory (C-BLSTM), a continual learning algorithm based on the Bayesian LSTM model for domain incremental learning. C-BLSTM continually learns a sequence of tasks by combining architectural pruning, variational inference-based regularization, and coreset replay strategies. In extensive experiments on two public electronic medical record datasets for mortality prediction, we show that C-BLSTM outperforms many state-of-the-art continual learning approaches. Further, we apply the C-BLSTM to two realworld clinical time series datasets for prediction of readmission risk in patients with heart failure and glycated haemoglobin outcomes in patients with type 2 diabetes.First, we show that these datasets exhibit domain incremental characteristics with significant drifts in their marginal distributions and moderate drifts in their conditional distributions. Then, we demonstrate that the C-BLSTM improves generalization in five diverse realworld scenarios spanning temporal, site, device, case mix, and ethnicity shifts, both in terms of performance and reliability of predictions.Keywords
Funding Information
- Agency for Science, Technology and Research (H19/01/a0/023)
- DesCartes Program
- National Research Foundation Singapore
- ASTAR Council Strategic Fund (C240314048)
- Economic Development Board - Singapore (S14-1035-RF-LLF H and W)
This publication has 44 references indexed in Scilit:
- Revisiting Class-Incremental Learning with Pre-Trained Models: Generalizability and Adaptivity are All You NeedInternational Journal of Computer Vision, 2024
- Improving transparency and representational generalizability through parallel continual learningNeural Networks, 2023
- CVPR 2020 continual learning in computer vision competition: Approaches, results, current challenges and future directionsArtificial Intelligence, 2022
- Adversarial Continual Learning2020
- PODNet: Pooled Outputs Distillation for Small-Tasks Incremental Learning2020
- GDumb: A Simple Approach that Questions Our Progress in Continual Learning2020
- Online RBM: Growing Restricted Boltzmann Machine on the fly for unsupervised representationApplied Soft Computing, 2020
- Readmission prediction using deep learning on electronic health recordsJournal of Biomedical Informatics, 2019
- Continual lifelong learning with neural networks: A reviewNeural Networks, 2019
- Time Series Analysis (Stationarity, Cointegration, and Causality)2019