Adaptive Hyperparameter-Tuned Transformer–LSTM for Lithium-Ion Battery State-of-Health Prediction
Open Access
Abstract
Accurate prediction of lithium-ion battery state of health (SOH) is crucial for improving the safety, reliability, and operational efficiency of battery management systems (BMSs). However, many data-driven methods still struggle to maintain robust forecasting performance when degradation trajectories differ across cells, especially in later-stage aging. To address this issue, this study developed a robustness-oriented SOH prediction framework, termed Ada-TL, by integrating a Transformer encoder, an LSTM regressor, and adaptive hyperparameter tuning. Cycle-level health indicators were extracted from the publicly available CALCE dataset and transformed into a compact representation for supervised learning. The Transformer module captures non-local dependencies within each input window, whereas the LSTM summarizes sequential degradation dynamics. The number of attention heads, the initial learning rate, and the L2 regularization coefficient are adaptively optimized to reduce manual trial-and-error in model configuration. Experimental results on four CS2 cells show that Ada-TL consistently outperformed BP, CNN–LSTM, and the fixed-hyperparameter baseline in overall SOH prediction accuracy, achieving RMSE values of 0.0210–0.0310, MAE values of 0.0163–0.0262, and MAPE values of 4.17–9.30%. Additional late-stage and cumulative-drift analyses further indicate that Ada-TL provided more stable post-knee tracking and better control of long-horizon bias accumulation, with late-stage RMSE reduced to 0.0169–0.0217 across the four cells. An ablation study also showed that the KPCA-based three-dimensional representation improved the overall test-set accuracy on most cells while reducing input dimensionality. These results suggest that the main value of Ada-TL lies in robustness-oriented SOH forecasting under cell-to-cell variability.Keywords
This publication has 23 references indexed in Scilit:
- Interpretable AI for explaining and predicting battery state of health using PSO-enhanced deep learning modelsEnergy Reports, 2025
- Ensuring Battery Safety in Electric Vehicles: Challenges, Developments, and Future PerspectivesSmall, 2025
- SOC estimation for lithium batteries using a CNN-attention-LSTM modelJournal of Energy Storage, 2025
- Collaborative framework of Transformer and LSTM for enhanced state-of-charge estimation in lithium-ion batteriesEnergy, 2025
- Data‐Driven Battery Characterization and Prognosis: Recent Progress, Challenges, and ProspectsSmall Methods, 2024
- Design and optimization of lithium-ion battery as an efficient energy storage device for electric vehicles: A comprehensive reviewJournal of Energy Storage, 2023
- Early prediction of lithium-ion battery cycle life based on voltage-capacity discharge curvesJournal of Energy Storage, 2023
- Identification of internal polarization dynamics for solid oxide fuel cells investigated by electrochemical impedance spectroscopy and distribution of relaxation timesEnergy, 2022
- A review on passive and active strategies of enhancing the safety of lithium-ion batteriesInternational Journal of Heat and Mass Transfer, 2022
- How the distribution of relaxation times enhances complex equivalent circuit models for fuel cellsElectrochimica Acta, 2020