Neural-iLQR: A Learning-Aided Shooting Method for Trajectory Optimization
Open Access
- 4 December 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 27, 1-7
Abstract
Iterative linear quadratic regulator (iLQR) has gained wide popularity in addressing trajectory optimization problems with nonlinear system models. However, as a model-based shooting method, it relies heavily on an accurate system model to update the optimal control actions and the trajectory determined with forward integration, thus becoming vulnerable to inevitable model inaccuracies. Recently, substantial research efforts in learning-based methods for optimal control problems have been progressing significantly in addressing unknown system models, particularly when the system has complex interactions with the environment. Yet an incremental machine learning method or a deep neural network is normally required to fit a substantial scale of sampling motion data. Existing works mainly focus on capturing the whole picture of the motion pattern from trial data (which is essentially noisy and hard to identify with any simple predefined structures) for complex robot systems. Instead, we present Neural-iLQR, a learning-aided shooting method over the unconstrained control space, in which a neural network with a simple structure is used to drive the optimization process towards optimal direction. Through comprehensive evaluations on two illustrative control tasks using three different kinds of lightweight network structures, the proposed method is shown to outperform the conventional iLQR significantly with fast and continuous cost convergence in the presence of inaccuracies in system models, which demonstrates the generalizability and robustness of the proposed learning-aided method.Keywords
All Related Versions
Funding Information
- Department of Education of Guangdong Province
This publication has 22 references indexed in Scilit:
- Gait and Trajectory Optimization for Legged Systems Through Phase-Based End-Effector ParameterizationIEEE Robotics and Automation Letters, 2018
- Optimal control with learned local models: Application to dexterous manipulation2016
- Neural networks and differential dynamic programming for reinforcement learning problems2016
- Control-limited differential dynamic programming2014
- MuJoCo: A physics engine for model-based control2012
- Minimum snap trajectory generation and control for quadrotors2011
- Adaptive Optimal Feedback Control with Learned Internal Dynamics Models2010
- Pattern Recognition and Machine Learning2006
- ITERATIVE LINEAR QUADRATIC REGULATOR DESIGN FOR NONLINEAR BIOLOGICAL MOVEMENT SYSTEMS2004
- A Second-order Gradient Method for Determining Optimal Trajectories of Non-linear Discrete-time SystemsInternational Journal of Control, 1966