Energy Management for a Power-Split Plug-In Hybrid Electric Vehicle Based on Reinforcement Learning
Open Access
- 4 December 2018
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 8 (12) , 2494
Abstract
This paper proposes an energy management strategy for a power-split plug-in hybrid electric vehicle (PHEV) based on reinforcement learning (RL). Firstly, a control-oriented power-split PHEV model is built, and then the RL method is employed based on the Markov Decision Process (MDP) to find the optimal solution according to the built model. During the strategy search, several different standard driving schedules are chosen, and the transfer probability of the power demand is derived based on the Markov chain. Accordingly, the optimal control strategy is found by the Q-learning (QL) algorithm, which can decide suitable energy allocation between the gasoline engine and the battery pack. Simulation results indicate that the RL-based control strategy could not only lessen fuel consumption under different driving cycles, but also limit the maximum discharge power of battery, compared with the charging depletion/charging sustaining (CD/CS) method and the equivalent consumption minimization strategy (ECMS).Keywords
Funding Information
- National Key Research and Design Program of China (2018YFB0104000, 2018YFB0104900)
- National Natural Science Foundation of China (61763021, 51775063)
This publication has 32 references indexed in Scilit:
- Synergetic effects of Fe 3+ doped spinel Li 4 Ti 5 O 12 nanoparticles on reduced graphene oxide for high surface electrode hybrid supercapacitorsNanoscale, 2017
- High-Capacitance Hybrid Supercapacitor Based on Multi-Colored Fluorescent Carbon-DotsScientific Reports, 2017
- Charging, power management, and battery degradation mitigation in plug-in hybrid electric vehicles: A unified cost-optimal approachMechanical Systems and Signal Processing, 2017
- Rule based energy management strategy for a series–parallel plug-in hybrid electric bus optimized by dynamic programmingApplied Energy, 2017
- Energy Management in Plug-in Hybrid Electric Vehicles: Recent Progress and a Connected Vehicles PerspectiveIEEE Transactions on Vehicular Technology, 2016
- A review on hybrid electric vehicles architecture and energy management strategiesRenewable and Sustainable Energy Reviews, 2016
- A Real-Time Energy Management Architecture for Multisource Electric VehiclesIEEE Transactions on Industrial Electronics, 2014
- A Supervisory Control Strategy for Plug-In Hybrid Electric Vehicles Based on Energy Demand Prediction and Route PreviewIEEE Transactions on Vehicular Technology, 2014
- State-of-Charge Balance Using Adaptive Droop Control for Distributed Energy Storage Systems in DC Microgrid ApplicationsIEEE Transactions on Industrial Electronics, 2013
- Classification and Review of Control Strategies for Plug-In Hybrid Electric VehiclesIEEE Transactions on Vehicular Technology, 2010