Active Exploration in Iterative Gaussian Process Regression for Uncertainty Modeling in Autonomous Racing
- 18 July 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Control Systems Technology
- Vol. 33 (4) , 1301-1316
Abstract
Autonomous racing creates challenging control problems, but model predictive control (MPC) has made promising steps toward solving both the minimum lap-time problem and head-to-head racing. Yet, accurate models of the system are necessary for model-based control, including models of vehicle dynamics and opponent behavior. Both dynamics model error and opponent behavior can be modeled with Gaussian process (GP) regression. GP models can be updated iteratively from data collected using the controller, but the strength of the GP model depends on the diversity of the training data. We propose a novel active exploration mechanism for iterative GP regression that purposefully collects additional data at regions of higher uncertainty in the GP model. In the exploration, an MPC collects diverse data by balancing the racing objectives and the exploration criterion; then the GP is retrained. The process is repeated iteratively; in later iterations, the exploration is deactivated, and only the racing objectives are optimized. Thus, the MPC can achieve better performance by leveraging the improved GP model. We validate our approach in the highly realistic racing simulation platform Gran Turismo Sport of Sony Interactive Entertainment Inc for a minimum lap time challenge, and in numerical simulation of head-to-head. Our active exploration mechanism yields a significant improvement in the GP prediction accuracy compared to previous approaches and, thus, an improved racing performance.Keywords
All Related Versions
Funding Information
- fellowship within the “Research Grants for Doctoral Students” Program of the German Academic Exchange Service (DAAD) and the Bavaria California Technology Center (12-[2022-2)
- National Science Foundation Graduate Research Fellowship Program (DGE 1752814)
This publication has 37 references indexed in Scilit:
- Active learning in robotics: A review of control principlesMechatronics, 2021
- Multi-Hypothesis Interactions in Game-Theoretic Motion Planning2021
- Deep Structured Reactive Planning2021
- Super-Human Performance in Gran Turismo Sport Using Deep Reinforcement LearningIEEE Robotics and Automation Letters, 2021
- Learning-Based Model Predictive Control for Autonomous RacingIEEE Robotics and Automation Letters, 2019
- CasADi: a software framework for nonlinear optimization and optimal controlMathematical Programming Computation, 2018
- A generalized Nash equilibrium approach for optimal control problems of autonomous carsOptimal Control Applications and Methods, 2017
- Optimization‐based autonomous racing of 1:43 scale RC carsOptimal Control Applications and Methods, 2014
- Incremental online sparsification for model learning in real-time robot controlNeurocomputing, 2011
- On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programmingMathematical Programming, 2005