A MLP-Mixer and mixture of expert model for remaining useful life prediction of lithium-ion batteries
Open Access
- 16 December 2023
- journal article
- research article
- Published by Springer Nature in Frontiers of Computer Science
- Vol. 18 (5) , 1-10
Abstract
Accurately predicting the Remaining Useful Life (RUL) of lithium-ion batteries is crucial for battery management systems. Deep learning-based methods have been shown to be effective in predicting RUL by leveraging battery capacity time series data. However, the representation learning of features such as long-distance sequence dependencies and mutations in capacity time series still needs to be improved. To address this challenge, this paper proposes a novel deep learning model, the MLP-Mixer and Mixture of Expert (MMMe) model, for RUL prediction. The MMMe model leverages the Gated Recurrent Unit and Multi-Head Attention mechanism to encode the sequential data of battery capacity to capture the temporal features and a re-zero MLP-Mixer model to capture the high-level features. Additionally, we devise an ensemble predictor based on a Mixture-of-Experts (MoE) architecture to generate reliable RUL predictions. The experimental results on public datasets demonstrate that our proposed model significantly outperforms other existing methods, providing more reliable and precise RUL predictions while also accurately tracking the capacity degradation process. Our code and dataset are available at the website of github.Keywords
This publication has 37 references indexed in Scilit:
- Data-driven health estimation and lifetime prediction of lithium-ion batteries: A reviewRenewable and Sustainable Energy Reviews, 2019
- Remaining Useful Life Prediction Based on a Double-Convolutional Neural Network ArchitectureIEEE Transactions on Industrial Electronics, 2019
- Remaining Useful Life Prediction of Lithium-Ion Batteries Using Neural Network and Bat-Based Particle FilterIEEE Access, 2019
- A method for remaining useful life prediction of crystal oscillators using the Bayesian approach and extreme learning machine under uncertaintyNeurocomputing, 2018
- Long Short-Term Memory Recurrent Neural Network for Remaining Useful Life Prediction of Lithium-Ion BatteriesIEEE Transactions on Vehicular Technology, 2018
- Polynomial approximation pseudo-two-dimensional battery model for online application in embedded battery management systemEnergy, 2018
- RUL Prediction of Deteriorating Products Using an Adaptive Wiener Process ModelIEEE Transactions on Industrial Informatics, 2017
- Interacting multiple model particle filter for prognostics of lithium-ion batteriesMicroelectronics Reliability, 2017
- Remaining useful life prediction based on noisy condition monitoring signals using constrained Kalman filterReliability Engineering & System Safety, 2016
- Adaptive Mixtures of Local ExpertsNeural Computation, 1991