Neurodynamic Programming and Tracking Control for Nonlinear Stochastic Systems by PI Algorithm
- 10 February 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems II: Express Briefs
- Vol. 69 (6) , 2892-2896
Abstract
In this paper, for nonlinear stochastic systems, the optimal tracking control problem (OTCP) is solved by adaptive dynamic programming (ADP) techniques. Firstly, the complex OTCP is transformed into a stable control optimization problem by reconstructing a new stochastic augmented system. Then, simplifying the actor-critic architecture and reducing the computational load, critic neural networks (NNs) is used in iterative learning. And by using Lyapunov method, the ultimate uniform boundedness (UUB) of the tracking system is proved. To be precise, no literature has been published on the OTCP for nonlinear Itô type stochastic systems via the ADP method. This work is the first attempt in this field. Finally, in simulation, the method is applied to sinusoidal waveform and periodic rectangular step signal, and even unbounded exponential waveform.Keywords
Funding Information
- National Key Research and Development Program of China (2018YFA0702200)
- National Natural Science Foundation of China (61627809, 62173082)
- Liaoning Revitalization Talents Program (XLYC1801005)
This publication has 20 references indexed in Scilit:
- Tracking control optimization scheme of continuous-time nonlinear system via online single network adaptive critic design methodNeurocomputing, 2017
- Value Iteration Adaptive Dynamic Programming for Optimal Control of Discrete-Time Nonlinear SystemsIEEE Transactions on Cybernetics, 2015
- Optimal tracking control of nonlinear partially-unknown constrained-input systems using integral reinforcement learningAutomatica, 2014
- Reinforcement -learning for optimal tracking control of linear discrete-time systems with unknown dynamicsAutomatica, 2014
- Near-Optimal Control for Nonzero-Sum Differential Games of Continuous-Time Nonlinear Systems Using Single-Network ADPIEEE Transactions on Cybernetics, 2012
- Finite-horizon neuro-optimal tracking control for a class of discrete-time nonlinear systems using adaptive dynamic programming approachNeurocomputing, 2012
- Optimal Tracking Control for a Class of Nonlinear Discrete-Time Systems With Time Delays Based on Heuristic Dynamic ProgrammingIEEE Transactions on Neural Networks, 2011
- Data-Driven Robust Approximate Optimal Tracking Control for Unknown General Nonlinear Systems Using Adaptive Dynamic Programming MethodIEEE Transactions on Neural Networks, 2011
- An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential gamesAutomatica, 2011
- Neural-Network-Based Near-Optimal Control for a Class of Discrete-Time Affine Nonlinear Systems With Control ConstraintsIEEE Transactions on Neural Networks, 2009