CEL: A Continual Learning Model for Disease Outbreak Prediction by Leveraging Domain Adaptation via Elastic Weight Consolidation
- 28 February 2025
- journal article
- research article
- Published by Springer Nature in Interdisciplinary Sciences: Computational Life Sciences
- Vol. 17 (2) , 390-408
Abstract
Continual learning is the ability of a model to learn over time without forgetting previous knowledge. Therefore, adapting new data in dynamic fields like disease outbreak prediction is paramount. Deep neural networks are prone to error due to catastrophic forgetting. This study introduces a novel CEL model for Continual Learning by leveraging domain adaptation via Elastic weight consolidation (EWC). This model aims to mitigate the catastrophic forgetting phenomenon in a domain incremental setting. The Fisher information matrix (FIM) is constructed with EWC to develop a regularization term that penalizes changes to essential parameters. We conducted experiments on three distinct diseases, influenza, mpox, and measles, with customized metrics. The high R-squared values during evaluation and reevaluation outperform the other state-of-the-art models in several contexts. The results indicate that CEL adapts well to incremental data. CEL’s robustness emphasizes its minimal 65% forgetting rate and 18% higher memory stability compared to existing benchmark studies. This study highlights CEL's versatility in disease outbreak prediction by addressing evolving data with temporal patterns. It offers a valuable model for proactive disease control with accurate and timely predictions. Graphical AbstractKeywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62273322)
- Natural Science Foundation of Guangdong Province (2024A1515012269)
- Shenzhen Science and Technology Program (KQTD20190929172835662)
- Shenzhen Science and Technology Innovation Program (CJGJZD20220517142000002)
This publication has 48 references indexed in Scilit:
- Three types of incremental learningNature Machine Intelligence, 2022
- Dynamic memory to alleviate catastrophic forgetting in continual learning with medical imagingNature Communications, 2021
- A Short-Term Prediction Model at the Early Stage of the COVID-19 Pandemic Based on Multisource Urban DataIEEE Transactions on Computational Social Systems, 2021
- Continual updating and monitoring of clinical prediction models: time for dynamic prediction systems?Diagnostic and Prognostic Research, 2021
- Embracing Change: Continual Learning in Deep Neural NetworksTrends in Cognitive Sciences, 2020
- Clinical applications of continual learning machine learningThe Lancet Digital Health, 2020
- Continual lifelong learning with neural networks: A reviewNeural Networks, 2019
- Alleviating catastrophic forgetting using context-dependent gating and synaptic stabilizationProceedings of the National Academy of Sciences, 2018
- Learning without ForgettingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Overcoming catastrophic forgetting in neural networksProceedings of the National Academy of Sciences of the United States of America, 2017