Adaptive Dynamic Programming for Finite-Horizon Optimal Control of Discrete-Time Nonlinear Systems With $\varepsilon$-Error Bound
Authors:
Top Cited Papers
- 27 September 2010
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 22 (1) , 24-36
Abstract
In this paper, we study the finite-horizon optimal control problem for discrete-time nonlinear systems using the adaptive dynamic programming (ADP) approach. The idea is to use an iterative ADP algorithm to obtain the optimal control law which makes the performance index function close to the greatest lower bound of all performance indices within an -error bound. The optimal number of control steps can also be obtained by the proposed ADP algorithms. A convergence analysis of the proposed ADP algorithms in terms of performance index function and control policy is made. In order to facilitate the implementation of the iterative ADP algorithms, neural networks are used for approximating the performance index function, computing the optimal control policy, and modeling the nonlinear system. Finally, two simulation examples are employed to illustrate the applicability of the proposed method.Keywords
This publication has 52 references indexed in Scilit:
- $H_{\infty}$ Control of Discrete-Time Systems With Multiple Input DelaysIEEE Transactions on Automatic Control, 2007
- Adaptive Critic Designs for Discrete-Time Zero-Sum Games With Application to $H_{\infty}$ ControlIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2007
- Optimal Control of Continuous-Time Switched Affine SystemsIEEE Transactions on Automatic Control, 2006
- Robustness of Policies in Constrained Markov Decision ProcessesIEEE Transactions on Automatic Control, 2006
- Finite horizon quadratic optimal control and a separation principle for Markovian jump linear systemsIEEE Transactions on Automatic Control, 2003
- Intelligent supply chain management using adaptive critic learningIEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 2003
- Helicopter trimming and tracking control using direct neural dynamic programmingIEEE Transactions on Neural Networks, 2003
- Adaptive dynamic programmingIEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 2002
- Online learning control by association and reinforcementIEEE Transactions on Neural Networks, 2001
- Adaptive-critic-based neural networks for aircraft optimal controlJournal of Guidance, Control, and Dynamics, 1996