Learning Time Reduction Using Warm-Start Methods for a Reinforcement Learning-Based Supervisory Control in Hybrid Electric Vehicle Applications
- 24 August 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Transportation Electrification
- Vol. 7 (2) , 626-635
Abstract
Reinforcement Learning (RL) is gradually being implemented in the Hybrid Electric Vehicle (HEV) supervisory control. Even though RL exhibits significant fuel consumption saving, the long learning time makes it hardly applicable in real-world vehicles. This study aims to reduce the learning iterations of Q-learning in HEV application utilizing warm start methods. Different from previous studies, which initiated Q-learning with zero or random Q values, this study initiates the Q-learning with different supervisory controls, and detailed analysis is given. The results show that the proposed warm start Q-learning requires 68.8% fewer iterations than cold start Q-learning, and improves 10-16% MPG compared to Equivalent Consumption Minimization Strategy control. The results of this study can be used to facilitate the deployment of RL in vehicle applications.Keywords
All Related Versions
This publication has 30 references indexed in Scilit:
- Combining Knowledge with Deep Convolutional Neural Networks for Short Text Classification2017
- Harnessing Deep Neural Networks with Logic Rules2016
- Data-Driven Reinforcement Learning–Based Real-Time Energy Management System for Plug-In Hybrid Electric VehiclesTransportation Research Record: Journal of the Transportation Research Board, 2016
- Experimental investigation on the dynamic performance of a hybrid PEM fuel cell/battery system for lightweight electric vehicle applicationApplied Energy, 2011
- A Comparative Study Of Supervisory Control Strategies for Hybrid Electric VehiclesIEEE Transactions on Control Systems Technology, 2007
- Optimization of power management in an hybrid electric vehicle using dynamic programmingMathematics and Computers in Simulation, 2006
- Multiagent learning using a variable learning rateArtificial Intelligence, 2002
- Unified modeling of hybrid electric vehicle drivetrainsIEEE/ASME Transactions on Mechatronics, 1999
- Reinforcement Learning: An IntroductionIEEE Transactions on Neural Networks, 1998
- Dynamic ProgrammingScience, 1966