AnyCar to Anywhere: Learning Universal Dynamics Model for Agile and Adaptive Mobility
Authors:
- 19 May 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 8819-8825
Abstract
Recent works in the robot learning community have successfully introduced generalist models capable of controlling various robot embodiments across a wide range of tasks, such as navigation and locomotion. However, achieving agile control, which pushes the limits of robotic performance, still relies on specialist models that require extensive parameter tuning. To leverage generalist-model adaptability and flexibility while achieving specialist-level agility, we propose AnyCar, a transformer-based generalist dynamics model designed for agile control of various wheeled robots. To collect training data, we unify multiple simulators and leverage different physics backends to simulate vehicles with diverse sizes, scales, and physical properties across various terrains. With robust training and real-world fine-tuning, our model enables precise adaptation to different vehicles, even in the wild and under large state estimation errors. In real-world experiments, AnyCar shows both few-shot and zero-shot generalization across a wide range of vehicles and environments, where our model, combined with a sampling-based MPC, outperforms specialist models by up to 54%. These results represent a key step toward building a foundation model for agile wheeled robot control. AnyCar is fully open-source to support further research.Keywords
All Related Versions
This publication has 29 references indexed in Scilit:
- Pay Attention to How You Drive: Safe and Adaptive Model-Based Reinforcement Learning for Off-Road Driving2024
- Adaptive Planning and Control with Time-Varying Tire Models for Autonomous Racing Using Extreme Learning Machine2024
- TartanDrive 2.0: More Modalities and Better Infrastructure to Further Self-Supervised Learning Research in Off-Road Driving Tasks2024
- Safe Deep Policy Adaptation2024
- Transformers for modeling physical systemsNeural Networks, 2022
- Neural Lander: Stable Drone Landing Control Using Learned Dynamics2019
- Information theoretic MPC for model-based reinforcement learning2017
- Aggressive driving with model predictive path integral control2016
- A Generalized Extended Kalman Filter Implementation for the Robot Operating System2015
- Model learning for robot control: a surveyCognitive Processing, 2011