Personalized Car Following for Autonomous Driving with Inverse Reinforcement Learning
Authors:
- 23 May 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2891-2897
Abstract
Driving automation is gradually replacing human driving maneuvers in different applications such as adaptive cruise control and lane keeping. However, contemporary driving automation applications based on expert systems or prede-fined control strategies are not in line with individual human driver's preference. To overcome this problem, we propose a Personalized Adaptive Cruise Control (P-ACC) system that can learn the driver's car-following preferences from historical data using model-based maximum entropy Inverse Reinforcement Learning (IRL). Once activated in real-time, the P-ACC system first classifies the driver type and the weather type (at that moment). The vehicle is then controlled using the pre-trained IRL model on the cloud of the associated class. The personalized IRL model on the cloud will be updated as more human driving data is collected from various scenarios. Numerical simulation with real-world naturalistic driving data shows that, the accuracy of reproducing the real-world driving profile improves up to 30.1% in terms of speed and 36.5% in terms of distance gap, when P-ACC is compared with the Intelligent Driver Model (IDM). Game engine-based human-in-the-loop simulation demonstrates that, the takeover frequency of the driver during the usage of P-ACC decreases up to 93.4%, compared with that during the usage of IDM-based ACC.Keywords
This publication has 17 references indexed in Scilit:
- Driver Behavior Modeling Using Game Engine and Real Vehicle: A Learning-Based ApproachIEEE Transactions on Intelligent Vehicles, 2020
- Cooperative Ramp Merging System: Agent-Based Modeling and Simulation Using Game EngineSAE International Journal of Connected and Automated Vehicles, 2019
- Car-following method based on inverse reinforcement learning for autonomous vehicle decision-makingInternational Journal of Advanced Robotic Systems, 2018
- A car-following model considering asymmetric driving behavior based on long short-term memory neural networksTransportation Research Part C: Emerging Technologies, 2018
- Model Predictive Control system design for car-following behavior in real traffic flow2012
- Simulation of Driver Behavior with Agent-Based Back-Propagation Neural NetworkTransportation Research Record: Journal of the Transportation Research Board, 2011
- Develop a car-following model using data collected by "five-wheel system"2004
- A simplified car-following theory: a lower order modelTransportation Research Part B: Methodological, 2002
- Dynamical model of traffic congestion and numerical simulationPhysical Review E, 1995
- A behavioural car-following model for computer simulationTransportation Research Part B: Methodological, 1981