Improved value iteration for nonlinear tracking control with accelerated learning
- 3 January 2024
- journal article
- research article
- Published by Wiley in International Journal of Robust and Nonlinear Control
- Vol. 34 (6) , 4112-4131
Abstract
In this article, an adaptive critic scheme with a novel performance index function is developed to solve the tracking control problem, which eliminates the tracking error and possesses the adjustable convergence rate in the offline learning process. Under some conditions, the convergence and monotonicity of the accelerated value function sequence can be guaranteed. Combining the advantages of the adjustable and general value iteration schemes, an integrated algorithm is proposed with a fast guaranteed convergence, which involves two stages, namely the acceleration stage and the convergence stage. Moreover, an effective approach is given to adaptively determine the acceleration interval. With this operation, the fast convergence of the new value iteration scheme can be fully utilized. Finally, compared with the general value iteration, the numerical results are presented to verify the fast convergence and the tracking performance of the developed adaptive critic design.Keywords
Funding Information
- National Natural Science Foundation of China (62222301, 61890930‐5, 62021003)
- National Key Research and Development Program of China (2021ZD0112302, 2021ZD0112301, 2018YFC1900800‐5)
- Beijing Natural Science Foundation (JQ19013)
This publication has 32 references indexed in Scilit:
- Value Iteration Adaptive Dynamic Programming for Optimal Control of Discrete-Time Nonlinear SystemsIEEE Transactions on Cybernetics, 2015
- Online Supplementary ADP Learning Controller Design and Application to Power System Frequency Control With Large-Scale Wind Energy IntegrationIEEE Transactions on Neural Networks and Learning Systems, 2015
- Optimal Tracking Control of Unknown Discrete-Time Linear Systems Using Input-Output Measured DataIEEE Transactions on Cybernetics, 2015
- Approximate optimal trajectory tracking for continuous-time nonlinear systemsAutomatica, 2015
- Actor–Critic-Based Optimal Tracking for Partially Unknown Nonlinear Discrete-Time SystemsIEEE Transactions on Neural Networks and Learning Systems, 2014
- Optimal tracking control of nonlinear partially-unknown constrained-input systems using integral reinforcement learningAutomatica, 2014
- Reinforcement -learning for optimal tracking control of linear discrete-time systems with unknown dynamicsAutomatica, 2014
- Finite-horizon neuro-optimal tracking control for a class of discrete-time nonlinear systems using adaptive dynamic programming approachNeurocomputing, 2012
- Relaxed dynamic programming in switching systemsIEE Proceedings - Control Theory and Applications, 2006
- Online learning control by association and reinforcementIEEE Transactions on Neural Networks, 2001