Event-Driven Guaranteed Cost Control Design for Nonlinear Systems With Actuator Faults via Reinforcement Learning Algorithm
- 24 October 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics: Systems
- Vol. 50 (11) , 4135-4150
Abstract
This article presents a novel event-driven guaranteed cost control method for nonlinear systems subject to actuator faults. For the purpose of handling the problem of actuator faults and obtaining the event-driven approximate optimal guaranteed cost control approach for general nonlinear dynamics, the reinforcement learning (RL) algorithm is utilized to develop a sliding-mode control (SMC) strategy. To begin with, the unknown faults can be estimated by designing a fault observer. Meanwhile, an SMC technique is presented aiming at countering the effect of abrupt faults. In addition, the optimal performance of the equivalent sliding mode dynamics is considered, then an event-driven guaranteed cost control mechanism is implemented by using RL principle. In the control process, a general cost function, which has a simpler structure, is given to reduce the computation complexity. At the same time, a modified cost function is approximated to obtain optimal guaranteed cost control by using a single critic neural network (NN). In addition, a modified weight update law for critic NN is presented to relax the persistence of excitation (PE) condition. Moreover, a newly triggering condition, which is easy to be implemented, is designed, and the critic NN update law makes sure that the system states are stable. Furthermore, in light of the Lyapunov analysis, it is demonstrated that the developed event-driven control method guarantees the uniformly ultimately bounded (UUB) property of all the signals. Finally, three simulation results are given to validate the designed control method.Keywords
Funding Information
- National Natural Science Foundation of China (61433004, 61627809, 61621004)
- Liaoning Revitalization Talents Program (XLYC1801005)
This publication has 62 references indexed in Scilit:
- Adaptive Optimal Control of Unknown Constrained-Input Systems Using Policy Iteration and Neural NetworksIEEE Transactions on Neural Networks and Learning Systems, 2013
- A novel actor–critic–identifier architecture for approximate optimal control of uncertain nonlinear systemsAutomatica, 2013
- Adaptive fault‐tolerant robust control for a linear system with adaptive fault identificationIET Control Theory & Applications, 2013
- Application of the redundant servomotor approach to design of path generator with dynamic performance improvementMechanism and Machine Theory, 2011
- Toward a resilient manufacturing systemCIRP Annals, 2011
- An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential gamesAutomatica, 2011
- Robust fuzzy static output feedback control of T-S fuzzy systems with parametric uncertaintiesFuzzy Sets and Systems, 2007
- Fault-tolerant control of continuous-variable systems2003
- Decentralized tracking for a class of interconnected nonlinear systems using variable structure controlAutomatica, 1988
- Adaptive guaranteed cost control of systems with uncertain parametersIEEE Transactions on Automatic Control, 1972