Finite-horizon neural network-based optimal control design for affine nonlinear continuous-time systems
Authors:
- 1 August 2013
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 21614393,p. 1-6
Abstract
In this paper, the finite-horizon optimal control design for affine nonlinear continuous-time systems in the presence of known system dynamics is presented. A neural network (NN) is utilized to learn the time-varying solution of the Hamilton-Jacobi-Bellman (HJB) equation in an online and forward in time manner. To handle the time varying nature of the value function, the NN with constant weights and time-varying activation function is considered. The update law for tuning the NN weights is derived based on normalized gradient descent approach. To satisfy the terminal constraint and ensure stability, additional terms, one corresponding to the terminal constraint, and the other to stabilize the nonlinear system are added to the novel updating law. A uniformly ultimately boundedness of the non-autonomous closed-loop system is verified by using standard Lyapunov theory. The effectiveness of the proposed method is verified by simulation results.Keywords
This publication has 9 references indexed in Scilit:
- Finite-Horizon Control-Constrained Nonlinear Optimal Control Using Single Network Adaptive CriticsIEEE Transactions on Neural Networks and Learning Systems, 2012
- Stochastic optimal control of unknown linear networked control system in the presence of random delays and packet lossesAutomatica, 2012
- Online Optimal Control of Affine Nonlinear Discrete-Time Systems With Unknown Internal Dynamics by Using Time-Based Policy UpdateIEEE Transactions on Neural Networks and Learning Systems, 2012
- Optimal control of affine nonlinear continuous-time systems using an online Hamilton-Jacobi-Isaacs formulation2010
- Adaptive Dynamic Programming for Finite-Horizon Optimal Control of Discrete-Time Nonlinear Systems With $\varepsilon$-Error BoundIEEE Transactions on Neural Networks, 2010
- Adaptive optimal controllers based on Generalized Policy Iteration in a continuous-time framework2009
- A neural network solution for fixed-final time optimal control of nonlinear systemsAutomatica, 2007
- Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approachAutomatica, 2005
- Persistence of excitation in linear systemsSystems & Control Letters, 1986