Towards Socially Responsive Autonomous Vehicles: A Reinforcement Learning Framework With Driving Priors and Coordination Awareness
- 13 November 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Vehicles
- Vol. 9 (1) , 827-838
Abstract
The advent of autonomous vehicles (AVs) alongside human-driven vehicles (HVs) has ushered in an era of mixed traffic flow, presenting a significant challenge: the intricate interaction between these entities within complex driving environments. AVs are expected to have human-like driving behavior to seamlessly integrate into human-dominated traffic systems. To address this issue, we propose a reinforcement learning framework that considers driving priors and Social Coordination Awareness (SCA) to optimize the behavior of AVs. The framework integrates a driving prior learning (DPL) model based on a variational autoencoder to infer the driver's driving priors from human drivers' trajectories. A policy network based on a multi-head attention mechanism is designed to effectively capture the interactive dependencies between AVs and other traffic participants to improve decision-making quality. The introduction of SCA into the autonomous driving decision-making system, and the use of Coordination Tendency (CT) to quantify the willingness of AVs to coordinate the traffic system is explored. The unsignalized intersection serves as a representative experimental scenario. Simulation results show that the proposed framework can not only improve the decision-making quality of AVs but also motivate them to produce social behaviors, with potential benefits for the safety and traffic efficiency of the entire transportation system.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (52302502, 52125208, 52272313)
- National Key R&D Program of China (2022YFB2502901)
- CAST (2022QNRC001)
- Fundamental Research Funds for the Central Universities
This publication has 37 references indexed in Scilit:
- Autoencoders2023
- Conflict resolution for connected automated vehicles at unsignalized roundabouts considering personalized driving behavioursGreen Energy and Intelligent Transportation, 2022
- Autonomous Overtaking for Intelligent Vehicles Considering Social Preference Based on Hierarchical Reinforcement LearningAutomotive Innovation, 2022
- End-to-End Autonomous Driving Through Dueling Double Deep Q-NetworkAutomotive Innovation, 2021
- A Game-Theoretic Reinforcement Learning Approach for Adaptive Interaction at Intersections2020
- Social behavior for autonomous vehiclesProceedings of the National Academy of Sciences, 2019
- A review on vehicle modeling and control technics used for autonomous vehicle path following2017
- Social LSTM: Human Trajectory Prediction in Crowded Spaces2016
- Partially Observable Markov Decision Processes2012
- Enhanced intelligent driver model to access the impact of driving strategies on traffic capacityPhilosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 2010