Event-Triggered Optimal Control for Partially Unknown Constrained-Input Systems via Adaptive Dynamic Programming
Authors:
Top Cited Papers
Open Access
- 2 August 2016
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Electronics
- Vol. 64 (5) , 4101-4109
Abstract
Event-triggered control has been an effective tool in dealing with problems with finite communication and computation resources. In this paper, we design an event-triggered control for nonlinear constrained-input continuous-time systems based on the optimal policy. Constraints on controls are handled using a bounded function. To learn the optimal solution with partially unknown dynamics, an online adaptive dynamic programming algorithm is proposed. The identifier network, the critic network, and the actor network are employed to approximate the unknown drift dynamics, the optimal value, and the optimal policy, respectively. The identifier is tuned based on online data, which further trains the critic and actor at triggering instants. A concurrent learning technique repeatedly uses past data to train the critic. Stability of the closed-loop system, and convergence of neural networks to the optimal solutions are proved by Lyapunov analysis. In the end, the algorithm is applied to the overhead crane system to observe the performance. The event-triggered optimal controller with constraints stabilizes the system and consumes much less sampling times.Keywords
Funding Information
- National Natural Science Foundation of China (61273136, 61573353, 61533017, 51529701, 61520106009)
- Early Career Development Award of SKLMCCS
- State Key Laboratory of Robotics and System (SKLRS-2015-ZD-04)
This publication has 23 references indexed in Scilit:
- Near Optimal Event-Triggered Control of Nonlinear Discrete-Time Systems Using Neurodynamic ProgrammingIEEE Transactions on Neural Networks and Learning Systems, 2015
- $ {H}_{ {\infty }}$ Tracking Control of Completely Unknown Continuous-Time Systems via Off-Policy Reinforcement LearningIEEE Transactions on Neural Networks and Learning Systems, 2015
- Stochastic adaptive event‐triggered control and network scheduling protocol co‐design for distributed networked systemsIET Control Theory & Applications, 2014
- A novel dual iterative Q-learning method for optimal battery management in smart residential environmentsIEEE Transactions on Industrial Electronics, 2014
- Robust Adaptive Dynamic Programming and Feedback Stabilization of Nonlinear SystemsIEEE Transactions on Neural Networks and Learning Systems, 2014
- Integral reinforcement learning and experience replay for adaptive optimal control of partially-unknown constrained-input continuous-time systemsAutomatica, 2014
- A novel actor–critic–identifier architecture for approximate optimal control of uncertain nonlinear systemsAutomatica, 2013
- Online actor–critic algorithm to solve the continuous-time infinite horizon optimal control problemAutomatica, 2010
- Event-Triggered Feedback in Control, Estimation, and Optimization2010
- Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approachAutomatica, 2005