Ecological Adaptive Cruise Control for Vehicles With Step-Gear Transmission Based on Reinforcement Learning
- 23 October 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 21 (11) , 4895-4905
Abstract
In this paper an ecological adaptive cruise controller to reduce the fuel consumption and ensure the safe inter-vehicle distance for vehicles with step-gear transmissions is presented. An optimal control strategy using reinforcement learning with a novel actor-gear-critic architecture is proposed to obtain the continuous traction force trajectory and the discrete gear shift schedule. The traction force is determined from an actor network to maintain a desired inter-vehicle distance which improves the driving safety in a car-following process. The gear shift schedule is derived from a gear network to reduce the fuel consumption. The control strategy is model-free and allows continuous online learning for different driving situations without look-ahead velocity information. Particularly the nonlinear vehicle dynamics, the nonlinear transmission efficiency map for different gear ratios, and the nonlinear fuel consumption map are learned for fuel consumption reduction. The proposed controller is evaluated for different driving scenarios to demonstrate its robustness. Furthermore simulation comparisons for different gear shift schedules and velocity trajectories are given underling the advantages in terms of fuel economy and driving safety.Keywords
Funding Information
- China Scholarship Council
This publication has 30 references indexed in Scilit:
- A Review of Communication, Driver Characteristics, and Controls Aspects of Cooperative Adaptive Cruise Control (CACC)IEEE Transactions on Intelligent Transportation Systems, 2015
- Ecological Adaptive Cruise Controller for Plug-In Hybrid Electric Vehicles Using Nonlinear Model Predictive ControlIEEE Transactions on Intelligent Transportation Systems, 2015
- Fuel-Optimal Cruising Strategy for Road Vehicles With Step-Gear Mechanical TransmissionIEEE Transactions on Intelligent Transportation Systems, 2015
- Dynamics of connected vehicle systems with delayed acceleration feedbackTransportation Research Part C: Emerging Technologies, 2014
- Full-range adaptive cruise control based on supervised adaptive dynamic programmingNeurocomputing, 2014
- Eco-driving: Strategic, tactical, and operational decisions of the driver that influence vehicle fuel economyTransport Policy, 2012
- Optimal control of a class of hybrid systemsIEEE Transactions on Automatic Control, 2001
- Online learning control by association and reinforcementIEEE Transactions on Neural Networks, 2001
- Control of systems integrating logic, dynamics, and constraintsAutomatica, 1999
- Reinforcement Learning: An IntroductionIEEE Transactions on Neural Networks, 1998