Co-Optimization of On-Ramp Merging and Plug-In Hybrid Electric Vehicle Power Split Using Deep Reinforcement Learning
- 14 April 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 71 (7) , 6958-6968
Abstract
Current research on Deep ReinforcementLearning (DRL) for automated on-ramp merging neglects vehicle powertrain and dynamics. This work considers automated on-ramp merging for a power-split Plug-In Hybrid Electric Vehicle (PHEV), the 2015 Toyota Prius Plug-In, using DRL. The on-ramp merging control and the PHEV energy management are co-optimized such that the DRL policy directly outputs the power split between the engine and the electric motor. The testing results show that DRL can be successfully used for co-optimization, leading to collision-free on-ramp merging. When compared with sequential approaches wherein the upper-level on-ramp merging control and the lower-level PHEV energy management are performed independently and in sequence, we found that co-optimization results in economic but jerky on-ramp merging while sequential approaches may result in collisions due to neglecting powertrain power limit constraints in designing the upper-level on-ramp merging controller.Keywords
All Related Versions
Funding Information
- Natural Sciences and Engineering Research Council of Canada
This publication has 40 references indexed in Scilit:
- Fuel consumption optimization for smart hybrid electric vehicle during a car-following processMechanical Systems and Signal Processing, 2017
- Rule based energy management strategy for a series–parallel plug-in hybrid electric bus optimized by dynamic programmingApplied Energy, 2017
- A Survey on the Coordination of Connected and Automated Vehicles at Intersections and Merging at Highway On-RampsIEEE Transactions on Intelligent Transportation Systems, 2016
- Mastering the game of Go with deep neural networks and tree searchNature, 2016
- Ecological Adaptive Cruise Controller for Plug-In Hybrid Electric Vehicles Using Nonlinear Model Predictive ControlIEEE Transactions on Intelligent Transportation Systems, 2015
- Real-time predictive control strategy for a plug-in hybrid electric powertrainMechatronics, 2015
- A Comparative Analysis of Route‐Based Energy Management Systems for PhevsAsian Journal of Control, 2015
- High-Fidelity Modeling of a Power-Split Plug-In Hybrid Electric Powertrain for Control Performance Evaluation2013
- Congested traffic states in empirical observations and microscopic simulationsPhysical Review E, 2000
- Reinforcement Learning: An IntroductionIEEE Transactions on Neural Networks, 1998