Economical Thermal Energy Management for Hybrid Electric Vehicles Based on Multiple Agents Deep Reinforcement Learning
- 26 December 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Transportation Electrification
- Vol. 12 (2) , 3307-3318
Abstract
Hybrid electric vehicles (HEVs) encounter the challenge of restricted versatility in harsh weather conditions, as the thermal management system (TMS) consumes noteworthy energy to control battery and cabin temperature. This article proposes an economical thermal energy management system (eTEMS) and achieves multiobjective optimal control based on a multiple agents deep reinforcement learning (DRL) algorithm. First, a control-oriented coupled model of a hybrid powertrain and TMS is designed to minimize energy loss. Second, the multiple agents deep deterministic policy gradient (DDPG) is formulated to attain cooperative optimization of fuel economy, battery lifespan preservation, and cabin thermal comfort. Moreover, centralized and decentralized training architecture is tailored to enhance training efficiency and ensure optimal performance. Finally, the real-time performance of the proposed strategy is verified by hardware-in-the-loop (HIL). The results of the HIL experiment indicate that the proposed strategy can reduce the vehicle driving costs in cold and hot environments by 13.28% and 7.1% respectively, while ensuring battery life and cabin thermal comfort. The real-time performance of the proposed strategy is maintained at the millisecond level in the HIL experiment, providing a comprehensive energy-saving solution for HEVs under diverse weather conditions.Keywords
Funding Information
- National Natural Science Foundation of China (52222215)
- National Natural Science Foundation of China (52072051)
- National Science Fund for Distinguished Young Scholars (CSTB2023NSCQ-JQX0003)
This publication has 34 references indexed in Scilit:
- Research on thermal energy management for PHEV based on NSGA-II optimization algorithmCase Studies in Thermal Engineering, 2024
- Optimization of the energy management system in hybrid electric vehicles considering cabin temperatureApplied Thermal Engineering, 2024
- Optimal battery thermal management for electric vehicles with battery degradation minimizationApplied Energy, 2023
- Training-efficient and cost-optimal energy management for fuel cell hybrid electric bus based on a novel distributed deep reinforcement learning frameworkApplied Energy, 2023
- Battery thermal- and cabin comfort-aware collaborative energy management for plug-in fuel cell electric vehicles based on the soft actor-critic algorithmEnergy Conversion and Management, 2023
- Predictive energy management for plug-in hybrid electric vehicles considering electric motor thermal dynamicsEnergy Conversion and Management, 2022
- A survey on multi-agent deep reinforcement learning: from the perspective of challenges and applicationsArtificial Intelligence Review, 2020
- A Self-learning intelligent passenger vehicle comfort cooling system control strategyApplied Thermal Engineering, 2020
- An adaptive ECMS with driving style recognition for energy optimization of parallel hybrid electric busesEnergy, 2019
- Thermal modeling and validation of temperature distributions in a prismatic lithium-ion battery at different discharge rates and varying boundary conditionsApplied Thermal Engineering, 2016