Optimal Design of Experiment for Electrochemical Parameter Identification of Li-ion Battery via Deep Reinforcement Learning
Authors:
- Mehmet Fatih OzkanMOMehmet Fatih Ozkan
- Samuel Filgueira da SilvaSSSamuel Filgueira da Silva
- Faissal El IdrissiFIFaissal El Idrissi
- Prashanth RameshPRPrashanth Ramesh
- Marcello CanovaMCMarcello Canova
Preprint
Abstract
Accurate parameter estimation in electrochemical battery models is essential for monitoring and assessing the performance of lithium-ion batteries (LiBs). This paper presents a novel approach that combines deep reinforcement learning (DRL) with an optimal experimental design (OED) framework to identify key electrochemical parameters of LiB cell models. The proposed method utilizes the twin delayed deep deterministic policy gradient (TD3) algorithm to optimize input excitation, thereby increasing the sensitivity of the system response to electrochemical parameters. The performance of this DRL-based approach is evaluated against a nonlinear model predictive control (NMPC) method and conventional tests. Results indicate that the DRL-based method provides superior information content, reflected in higher Fisher information (FI) values and lower parameter estimation errors compared to the NMPC design and conventional test practices. Additionally, the DRL approach offers a substantial reduction in experimental time and computational resources.Keywords
All Related Versions
This publication has 11 references indexed in Scilit:
- Deep Reinforcement Learning Versus Evolution Strategies: A Comparative SurveyIEEE Transactions on Neural Networks and Learning Systems, 2023
- Reinforcement Learning of Optimal Input Excitation for Parameter Estimation With Application to Li-Ion BatteryIEEE Transactions on Industrial Informatics, 2023
- Improving Aging Identifiability of Lithium-Ion Batteries Using Deep Reinforcement LearningIEEE Transactions on Transportation Electrification, 2022
- New data optimization framework for parameter estimation under uncertainties with application to lithium-ion batteryApplied Energy, 2021
- Parameter Identification for Electrochemical Models of Lithium-Ion Batteries Using Sensitivity AnalysisASME Letters in Dynamic Systems and Control, 2021
- Development of Experimental Techniques for Parameterization of Multi-scale Lithium-ion Battery ModelsJournal of the Electrochemical Society, 2020
- Global Sensitivity Methods for Design of Experiments in Lithium-ion Battery ContextIFAC-PapersOnLine, 2020
- Modeling and Estimation for Advanced Battery ManagementAnnual Review of Control, Robotics, and Autonomous Systems, 2019
- Optimal Experimental Design for Parameterization of an Electrochemical Lithium-Ion Battery ModelJournal of the Electrochemical Society, 2018
- Electro-thermal battery model identification for automotive applicationsJournal of Power Sources, 2011