Efficient Game-Theoretic Planning With Prediction Heuristic for Socially-Compliant Autonomous Driving
- 15 July 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 7 (4) , 10248-10255
Abstract
Planning under social interactions with other agents is an essential problem for autonomous driving. As the actions of the autonomous vehicle in the interactions affect and are also affected by other agents, autonomous vehicles need to efficiently infer the reaction of the other agents. Most existing approaches formulate the problem as a generalized Nash equilibrium problem solved by optimization-based methods. However, they demand too much computational resource and easily fall into the local minimum due to the non-convexity. Monte Carlo Tree Search (MCTS) successfully tackles such issues in game-theoretic problems. However, as the interaction game tree grows exponentially, the general MCTS still requires a huge amount of iterations to reach the optima. In this paper, we introduce an efficient game-theoretic trajectory planning algorithm based on general MCTS by incorporating a prediction algorithm as a heuristic. On top of it, a social-compliant reward and a Bayesian inference algorithm are designed to generate diverse driving behaviors and identify the other driver's driving preference. Results demonstrate the effectiveness of the proposed framework with datasets containing naturalistic driving behavior in highly interactive scenarios.Keywords
All Related Versions
This publication has 21 references indexed in Scilit:
- Social behavior for autonomous vehiclesProceedings of the National Academy of Sciences of the United States of America, 2019
- Hierarchical Game-Theoretic Planning for Autonomous Vehicles2019
- Courteous Autonomous Cars2018
- Decentralized Cooperative Planning for Automated Vehicles with Hierarchical Monte Carlo Tree Search2018
- Game Theoretic Modeling of Driver and Vehicle Interactions for Verification and Validation of Autonomous Vehicle Control SystemsIEEE Transactions on Control Systems Technology, 2017
- A generalized Nash equilibrium approach for optimal control problems of autonomous carsOptimal Control Applications and Methods, 2017
- Information gathering actions over human internal state2016
- Planning for Autonomous Cars that Leverage Effects on Human Actions2016
- A Survey of Monte Carlo Tree Search MethodsIEEE Transactions on Computational Intelligence and AI in Games, 2012
- Robot Motion Planning: A Game-Theoretic FoundationAlgorithmica, 2000