Approximate Optimal Control of Affine Nonlinear Continuous-Time Systems Using Event-Sampled Neurodynamic Programming
Authors:
Open Access
- 7 April 2016
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 28 (3) , 639-652
Abstract
This paper presents an approximate optimal control of nonlinear continuous-time systems in affine form by using the adaptive dynamic programming (ADP) with event-sampled state and input vectors. The knowledge of the system dynamics is relaxed by using a neural network (NN) identifier with event-sampled inputs. The value function, which becomes an approximate solution to the Hamilton–Jacobi–Bellman equation, is generated by using event-sampled NN approximator. Subsequently, the NN identifier and the approximated value function are utilized to obtain the optimal control policy. Both the identifier and value function approximator weights are tuned only at the event-sampled instants leading to an aperiodic update scheme. A novel adaptive event sampling condition is designed to determine the sampling instants, such that the approximation accuracy and the stability are maintained. A positive lower bound on the minimum inter-sample time is guaranteed to avoid accumulation point, and the dependence of inter-sample time upon the NN weight estimates is analyzed. A local ultimate boundedness of the resulting nonlinear impulsive dynamical closed-loop system is shown. Finally, a numerical example is utilized to evaluate the performance of the near-optimal design. The net result is the design of an event-sampled ADP-based controller for nonlinear continuous-time systems.Keywords
Funding Information
- National Science Foundation (ECCS 1406533)
- Intelligent Systems Center, Missouri Science and Technology
This publication has 21 references indexed in Scilit:
- Adaptive Neural Network-Based Event-Triggered Control of Single-Input Single-Output Nonlinear Discrete-Time SystemsIEEE Transactions on Neural Networks and Learning Systems, 2015
- Near Optimal Event-Triggered Control of Nonlinear Discrete-Time Systems Using Neurodynamic ProgrammingIEEE Transactions on Neural Networks and Learning Systems, 2015
- Neural Network-Based Event-Triggered State Feedback Control of Nonlinear Continuous-Time SystemsIEEE Transactions on Neural Networks and Learning Systems, 2015
- Event-triggered optimal control of nonlinear continuous-time systems in affine form by using neural networks2014
- Global Adaptive Dynamic Programming for Continuous-Time Nonlinear Polynomial SystemsIFAC Proceedings Volumes, 2014
- Finite-horizon neural network-based optimal control design for affine nonlinear continuous-time systems2013
- Stochastic optimal control of unknown linear networked control system in the presence of random delays and packet lossesAutomatica, 2012
- Optimal control of affine nonlinear continuous-time systems2010
- Adaptive optimal controllers based on Generalized Policy Iteration in a continuous-time framework2009
- Stable Neural Hybrid Adaptive Control for Nonlinear Uncertain Impulsive Dynamical Systems2006