A Novel Iterative $\theta $-Adaptive Dynamic Programming for Discrete-Time Nonlinear Systems
Authors:
Open Access
- 25 September 2013
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 11 (4) , 1176-1190
Abstract
This paper is concerned with a new iterative θ-adaptive dynamic programming (ADP) technique to solve optimal control problems of infinite horizon discrete-time nonlinear systems. The idea is to use an iterative ADP algorithm to obtain the iterative control law which optimizes the iterative performance index function. In the present iterative θ-ADP algorithm, the condition of initial admissible control in policy iteration algorithm is avoided. It is proved that all the iterative controls obtained in the iterative θ-ADP algorithm can stabilize the nonlinear system which means that the iterative θ-ADP algorithm is feasible for implementations both online and offline. Convergence analysis of the performance index function is presented to guarantee that the iterative performance index function will converge to the optimum monotonically. Neural networks are used to approximate the performance index function and compute the optimal control policy, respectively, for facilitating the implementation of the iterative θ-ADP algorithm. Finally, two simulation examples are given to illustrate the performance of the established method.Keywords
This publication has 31 references indexed in Scilit:
- Finite-Horizon Control-Constrained Nonlinear Optimal Control Using Single Network Adaptive CriticsIEEE Transactions on Neural Networks and Learning Systems, 2012
- Optimal control of unknown nonaffine nonlinear discrete-time systems based on adaptive dynamic programmingAutomatica, 2012
- An iterative -optimal control scheme for a class of discrete-time nonlinear systems with unfixed initial stateNeural Networks, 2012
- An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential gamesAutomatica, 2011
- Adaptive Dynamic Programming for Finite-Horizon Optimal Control of Discrete-Time Nonlinear Systems With $\varepsilon$-Error BoundIEEE Transactions on Neural Networks, 2010
- Local feedback passivation of nonlinear discrete-time systems through the speed-gradient algorithmAutomatica, 2007
- Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approachAutomatica, 2005
- Adaptive dynamic programmingIEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 2002
- Online learning control by association and reinforcementIEEE Transactions on Neural Networks, 2001
- Non-linear discrete variable structure systems in quasi-sliding modeInternational Journal of Control, 1991