Reproducibility in the Control of Autonomous Mobility-on-Demand Systems
- 18 February 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Robotics
- Vol. 42 (15523098) , 1428-1447
Abstract
Autonomous Mobility-on-Demand (AMoD) systems, powered by advances in robotics, control, and Machine Learning (ML), offer a promising paradigm for future urban transportation. AMoD offers fast and personalized travel services by leveraging centralized control of autonomous vehicle fleets to optimize operations and enhance service performance. However, the rapid growth of this field has outpaced the development of standardized practices for evaluating and reporting results, leading to significant challenges in reproducibility. As AMoD control algorithms become increasingly complex and data-driven, a lack of transparency in modeling assumptions, experimental setups, and algorithmic implementation hinders scientific progress and undermines confidence in the results. This paper presents a systematic study of reproducibility in AMoD research. We identify key components across the research pipeline, spanning system modeling, control problems, simulation design, algorithm specification, and evaluation, and analyze common sources of irreproducibility. We survey prevalent practices in the literature, highlight gaps, and propose a structured framework to assess and improve reproducibility. While focused on AMoD, the principles and practices we advocate generalize to a broader class of cyber-physical systems that rely on networked autonomy and data-driven control. This work aims to lay the foundation for a more transparent and reproducible research culture in the design and deployment of intelligent mobility systems.Keywords
All Related Versions
Funding Information
- U.S. Department of Energy/Office of Energy Efficiency and Renewable Energy (DE-EE0011186)
- Sidara Urban Seed Grant Program at the Norman B. Leventhal Center
- Massachusetts Institute of Technology
This publication has 152 references indexed in Scilit:
- Reproducibility in machine‐learning‐based research: Overview, barriers, and driversAI Magazine, 2025
- Systems Benchmarking2020
- Evaluating the impact of spatio-temporal demand forecast aggregation on the operational performance of shared autonomous mobility fleetsTransportation, 2019
- Routing autonomous vehicles in congested transportation networks: structural properties and coordination algorithmsAutonomous Robots, 2018
- Best practices for comparing optimization algorithmsOptimization and Engineering, 2017
- Tracking a system of shared autonomous vehicles across the Austin, Texas network using agent-based simulationTransportation, 2017
- Dynamic ride-sharing and fleet sizing for a system of shared autonomous vehicles in Austin, TexasTransportation, 2016
- Autonomous Mobility-on-Demand Systems for Future Urban Mobility2015
- Wiley Series in Probability and Statistics2008
- The Hungarian method for the assignment problemNaval Research Logistics Quarterly, 1955