Nonlinear Model Predictive Control With Value Function Regression: A Tessellation‐Based Sampling Approach
- 1 December 2025
- journal article
- Published by Wiley in Optimal Control Applications and Methods
- Vol. 47 (1) , 254-274
Abstract
Advanced model‐based control strategies, such as Model Predictive Control (MPC), offer powerful solutions for managing complex dynamical systems. Despite its benefits, MPC faces significant computational challenges, particularly when applied to systems with fast dynamics and stringent real‐time constraints. To address these challenges, we leverage offline‐generated value function data to enhance real‐time MPC performance. The main parameter affecting the computational demand of MPC is the length of the prediction horizon. This work aims to reduce the length of the prediction horizon of a model predictive controller (MPC) to reduce computation time while maintaining optimality guarantees. To this end, we propose to approximate the trajectory optimization problem for MPC by learning a finite‐horizon value function. This approximated value function is then integrated into a truncated trajectory optimization problem, allowing the MPC to operate with a shorter prediction horizon and thus, ideally, lower computational demands. To manage the costly creation of the value function dataset, we propose a novel tessellation sampling strategy that directs attention to the important regions of the state space. Through this sampling strategy, we show that an effective and robust value function surrogate can be built, resulting in an accurate approximate MPC. The methodology is then validated experimentally on a Furuta pendulum, where it demonstrates the potential for real‐time MPC through learning methodologies. Here, we extend to a multi‐goal problem formulation. By leveraging the model properties of the Furuta system, we can avoid retraining the value function for multiple goals by applying an affine transformation to the value function domain.Keywords
Funding Information
- Flanders Make
This publication has 27 references indexed in Scilit:
- Fast Nonlinear Model Predictive Control Combining Online Trajectory Optimization and Value Function RegressionOptimal Control Applications and Methods, 2024
- Model Predictive Control and Reinforcement Learning: A Unified Framework Based on Dynamic ProgrammingIFAC-PapersOnLine, 2024
- Reinforced model predictive control (RL-MPC) for building energy managementApplied Energy, 2022
- Continuous‐time receding‐horizon reinforcement learning and its application to path‐tracking control of autonomous ground vehiclesOptimal Control Applications and Methods, 2021
- Deep learning‐based optimal tracking control of flow front position in an injection molding machineOptimal Control Applications and Methods, 2021
- Synthesis of control Lyapunov functions and stabilizing feedback strategies using exit‐time optimal control Part II: Numerical approachOptimal Control Applications and Methods, 2021
- CasADi: a software framework for nonlinear optimization and optimal controlMathematical Programming Computation, 2018
- Efficient Numerical Methods for Nonlinear MPC and Moving Horizon Estimation2009
- An overview of simultaneous strategies for dynamic optimizationChemical Engineering and Processing - Process Intensification, 2007
- Fast Direct Multiple Shooting Algorithms for Optimal Robot Control2007