Online Recursive Power Management Strategy Based on the Reinforcement Learning Algorithm With Cosine Similarity and a Forgetting Factor
- 21 April 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Electronics
- Vol. 68 (6) , 5013-5023
Abstract
An online recursive power management strategy based on the reinforcement learning technique is proposed to achieve an optimal power distribution and excellent economic performance of a plug-in fuel cell hybrid electric vehicle. First, the optimal control algorithm of power management strategy is formulated. Then, an online recursive algorithm using cosine similarity and a forgetting factor to achieve the adaptability of the proposed strategy to various driving conditions. The parameters updating framework is triggered once the change rate of cosine similarity exceeds the threshold value of the corresponding driving cycle. Some of the important parameters such as the learning rate, discount factor, forgetting factor and the change rate of cosine similarity are analyzed to optimize the online updating capability of the strategy. Finally, an experimental study is conducted to validate the effectiveness of the proposed strategy. Both a rule-based strategy and an equivalent consumption minimization strategy are implemented to establish the benchmark framework used to analyze the performance of the proposed strategy. The simulation and experimental results corroborate the effectiveness and economic performance of the proposed strategy. A comparison with the existing standard benchmark strategy, indicates the superior performance of the developed strategy reaching a remarkable reduction in energy consumption at long driving distance.Keywords
Funding Information
- National Natural Science Foundation of China (51505086)
- Opening Foundation of Key Laboratory of Advanced Manufacture Technology for Automobile Parts, Ministry of Education (2019KLMT06)
This publication has 28 references indexed in Scilit:
- Investigating adaptive-ECMS with velocity forecast ability for hybrid electric vehiclesApplied Energy, 2017
- Impact of the electric vehicles on the air pollution from a highwayApplied Energy, 2016
- Data-Driven Reinforcement Learning–Based Real-Time Energy Management System for Plug-In Hybrid Electric VehiclesTransportation Research Record: Journal of the Transportation Research Board, 2016
- A review on energy management system for fuel cell hybrid electric vehicle: Issues and challengesRenewable and Sustainable Energy Reviews, 2015
- Reinforcement Learning of Adaptive Energy Management With Transition Probability for a Hybrid Electric Tracked VehicleIEEE Transactions on Industrial Electronics, 2015
- A Parallel Hybrid Electric Vehicle Energy Management Strategy Using Stochastic Model Predictive Control With Road Grade PreviewIEEE Transactions on Control Systems Technology, 2015
- Optimization for a hybrid energy storage system in electric vehicles using dynamic programing approachApplied Energy, 2015
- Reinforcement learning based power management for hybrid electric vehicles2014
- Correctional DP-Based Energy Management Strategy of Plug-In Hybrid Electric Bus for City-Bus RouteIEEE Transactions on Vehicular Technology, 2014
- Real-World Robustness for Hybrid Vehicle Optimal Energy Management Strategies Incorporating Drivability MetricsJournal of Dynamic Systems, Measurement, and Control, 2014