A Value-Based Parallel Update MCTS Method for Multi-Agent Cooperative Decision-Making of Connected and Automated Vehicles
- 13 November 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 27 (1) , 1400-1415
Abstract
This paper addresses the problem of long term joint lateral and longitudinal decision-making for multi-vehicle cooperative driving among connected and automated vehicles (CAVs). We propose a Monte Carlo tree search (MCTS) method featuring parallel update mechanism and experiential action preference, with the problem modeled as a finite-horizon, time-discounted multi-agent Markov game. By enabling a single simulation rollout to prune entire families of hazardous actions simultaneously, parallel update mechanism dramatically accelerates the convergence of the search within the vast joint action space. The search is further focused by an experiential action preference heuristic that biases exploration towards efficient maneuvers. Evaluated in randomly generated mixed-traffic scenarios, our method significantly outperforms standard MCTS and reinforcement learning baselines in both safety and traffic efficiency. Crucially, in-depth analysis reveals the discovery of emergent, non-myopic cooperative strategies that are inaccessible to myopic planners. This work provides a computationally tractable solution for complex, multi-agent MCTS, achieving a higher level of strategic cooperative decision-making.Keywords
All Related Versions
This publication has 45 references indexed in Scilit:
- Optimal trajectory planning meets network-level routing: Integrated control framework for emerging mobility systemsAutomatica, 2025
- Monte Carlo Tree Search: a review of recent modifications and applicationsArtificial Intelligence Review, 2022
- A bi-level cooperative driving strategy allowing lane changesTransportation Research Part C: Emerging Technologies, 2020
- Regulations for on-road testing of connected and automated vehicles: Assessing the potential for global safety harmonizationTransportation Research Part A: Policy and Practice, 2020
- Decentralized optimal control of Connected Automated Vehicles at signal-free intersections including comfort-constrained turns and safety guaranteesAutomatica, 2019
- Development of a signal-head-free intersection control logic in a fully connected and autonomous vehicle environmentTransportation Research Part C: Emerging Technologies, 2018
- Vehicle-to-vehicle (V2V) and vehicle-to-infrastructure (V2I) communication in a heterogeneous wireless network – Performance evaluationTransportation Research Part C: Emerging Technologies, 2016
- SUMO’s Lane-Changing Model2015
- Multi-armed bandits with episode contextAnnals of Mathematics and Artificial Intelligence, 2011
- Bandit Based Monte-Carlo Planning2006