An Optimal Control Scheme for a Class of Discrete-time Nonlinear Systems with Time Delays Using Adaptive Dynamic Programming
Authors:
- 20 January 2010
- journal article
- Published by China Science Publishing & Media Ltd. in Acta Automatica Sinica
- Vol. 36 (1) , 121-129
Abstract
In this paper, an optimal control scheme for a class of nonlinear systems with time delays in both state and control variables with respect to a quadratic performance index function is proposed using a new iterative adaptive dynamic programming (ADP) algorithm. By introducing a delay matrix function, the explicit expression of the optimal control is obtained using the dynamic programming theory and the optimal control can iteratively be obtained using the adaptive critic technique. Convergence analysis is presented to prove that the performance index function can reach the optimum by the proposed method. Neural networks are used to approximate the performance index function, compute the optimal control policy, solve delay matrix function, and model the nonlinear system, respectively, for facilitating the implementation of the iterative ADP algorithm. Two examples are given to demonstrate the validity of the proposed optimal control scheme. Key words Adaptive dynamic programming (ADP), approximate dynamic programming, time delay, optimal control, nonlinear system, neural networks DOI 10.3724/SP.J.1004.2010.00121 The optimal control problem of nonlinear systems has always been a key focus in the control field in the last several decades. Coupled with this is the fact that noth-ing can happen instantaneously, as is so often presumeKeywords
This publication has 11 references indexed in Scilit:
- A Novel Infinite-Time Optimal Tracking Control Scheme for a Class of Discrete-Time Nonlinear Systems via the Greedy HDP Iteration AlgorithmIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2008
- Discrete-Time Nonlinear HJB Solution Using Approximate Dynamic Programming: Convergence ProofIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2008
- Adaptive Critic Learning Techniques for Engine Torque and Air–Fuel Ratio ControlIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2008
- Comparison of Adaptive Critic-Based and Classical Wide-Area Controllers for Power SystemsIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2008
- Delay-Dependent Guaranteed Cost Control for Uncertain Stochastic Fuzzy Systems With Multiple Time DelaysIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2008
- Guaranteed Cost Networked Control for T–S Fuzzy Systems With Time DelaysIEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 2007
- Adaptive Critic Designs for Discrete-Time Zero-Sum Games With Application to $H_{\infty}$ ControlIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2007
- Optimal Control for Linear Systems With Multiple Time Delays in Control InputIEEE Transactions on Automatic Control, 2006
- Time-delay systems: an overview of some recent advances and open problemsAutomatica, 2003
- Online learning control by association and reinforcementIEEE Transactions on Neural Networks, 2001