Neural-iLQR: A Learning-Aided Shooting Method for Trajectory Optimization
Preprint
Abstract
Iterative linear quadratic regulator (iLQR) has gained wide popularity in addressing trajectory optimization problems with nonlinear system models. However, as a model-based shooting method, it relies heavily on an accurate system model to update the optimal control actions and the trajectory determined with forward integration, thus becoming vulnerable to inevitable model inaccuracies. Recently, substantial research efforts in learning-based methods for optimal control problems have been progressing significantly in addressing unknown system models, particularly when the system has complex interactions with the environment. Yet a deep neural network is normally required to fit substantial scale of sampling data. In this work, we present Neural-iLQR, a learning-aided shooting method over the unconstrained control space, in which a neural network with a simple structure is used to represent the local system model. In this framework, the trajectory optimization task is achieved with simultaneous refinement of the optimal policy and the neural network iteratively, without relying on the prior knowledge of the system model. Through comprehensive evaluations on two illustrative control tasks, the proposed method is shown to outperform the conventional iLQR significantly in the presence of inaccuracies in system models.Keywords
All Related Versions
This publication has 8 references indexed in Scilit:
- Alternating Direction Method of Multipliers for Constrained Iterative LQR in Autonomous DrivingIEEE Transactions on Intelligent Transportation Systems, 2022
- A Two-Stage Optimization-Based Motion Planner for Safe Urban DrivingIEEE Transactions on Robotics, 2021
- An Iterative LQR Controller for Off-Road and On-Road Vehicles using a Neural Network Dynamics Model2020
- Robust Formation Control for Cooperative Underactuated Quadrotors via Reinforcement LearningIEEE Transactions on Neural Networks and Learning Systems, 2020
- Whole-Body MPC for a Dynamically Stable Mobile ManipulatorIEEE Robotics and Automation Letters, 2019
- Gait and Trajectory Optimization for Legged Systems Through Phase-Based End-Effector ParameterizationIEEE Robotics and Automation Letters, 2018
- An iterative linear quadratic regulator based trajectory tracking controller for wheeled mobile robotJournal of Zhejiang University SCIENCE C, 2012
- Dynamic Programming and Optimal Control. Volume 1Journal of the Operational Research Society, 1996