Robo-taxi Fleet Coordination at Scale via Reinforcement Learning
Preprint
Abstract
Fleets of robo-taxis offering on-demand transportation services, commonly known as Autonomous Mobility-on-Demand (AMoD) systems, hold significant promise for societal benefits, such as reducing pollution, energy consumption, and urban congestion. However, orchestrating these systems at scale remains a critical challenge, with existing coordination algorithms often failing to exploit the systems' full potential. This work introduces a novel decision-making framework that unites mathematical modeling with data-driven techniques. In particular, we present the AMoD coordination problem through the lens of reinforcement learning and propose a graph network-based framework that exploits the main strengths of graph representation learning, reinforcement learning, and classical operations research tools. Extensive evaluations across diverse simulation fidelities and scenarios demonstrate the flexibility of our approach, achieving superior system performance, computational efficiency, and generalizability compared to prior methods. Finally, motivated by the need to democratize research efforts in this area, we release publicly available benchmarks, datasets, and simulators for network-level coordination alongside an open-source codebase designed to provide accessible simulation platforms and establish a standardized validation process for comparing methodologies. Code available at: https://github.com/StanfordASL/RL4AMODKeywords
All Related Versions
This publication has 18 references indexed in Scilit:
- Dispatch of autonomous vehicles for taxi services: A deep reinforcement learning approachTransportation Research Part C: Emerging Technologies, 2020
- Ridesharing user equilibrium problem under OD-based surge pricing strategyTransportation Research Part B: Methodological, 2020
- Dynamic shared autonomous taxi system considering on-time arrival reliabilityTransportation Research Part C: Emerging Technologies, 2019
- Applications of Deep Reinforcement Learning in Communications and Networking: A SurveyIEEE Communications Surveys & Tutorials, 2019
- Microscopic Traffic Simulation using SUMO2018
- Dynamic autonomous vehicle fleet operations: Optimization-based strategies to assign AVs to immediate traveler demand requestsTransportation Research Part C: Emerging Technologies, 2018
- On-demand high-capacity ride-sharing via dynamic trip-vehicle assignmentProceedings of the National Academy of Sciences, 2017
- Network analysis of supply chain systems: A systematic review and future researchSystems Engineering, 2012
- A survey of the optimal power flow literatureIEEE Transactions on Power Systems, 1991
- An approximate analytic model of many-to-many demand responsive transportation systemsTransportation Research, 1978