Fault-tolerant control for nonlinear systems with a dead zone: Reinforcement learning approach
Authors:
Open Access
- 1 January 2023
- journal article
- research article
- Published by American Institute of Mathematical Sciences (AIMS) in Mathematical Biosciences and Engineering
- Vol. 20 (4) , 6334-6357
Abstract
This paper focuses on the adaptive reinforcement learning-based optimal control problem for standard nonstrict-feedback nonlinear systems with the actuator fault and an unknown dead zone. To simultaneously reduce the computational complexity and eliminate the local optimal problem, a novel neural network weight updated algorithm is presented to replace the classic gradient descent method. By utilizing the backstepping technique, the actor critic-based reinforcement learning control strategy is developed for high-order nonlinear nonstrict-feedback systems. In addition, two auxiliary parameters are presented to deal with the input dead zone and actuator fault respectively. All signals in the system are proven to be semi-globally uniformly ultimately bounded by Lyapunov theory analysis. At the end of the paper, some simulation results are shown to illustrate the remarkable effect of the proposed approach.Keywords
This publication has 35 references indexed in Scilit:
- Adaptive Fuzzy Tracking Control Design for SISO Uncertain Nonstrict Feedback Nonlinear SystemsIEEE Transactions on Fuzzy Systems, 2016
- Fuzzy Approximation-Based Adaptive Backstepping Optimal Control for a Class of Nonlinear Discrete-Time Systems With Dead-ZoneIEEE Transactions on Fuzzy Systems, 2015
- Reinforcement Learning Design-Based Adaptive Tracking Control With Less Learning Parameters for Nonlinear Discrete-Time MIMO SystemsIEEE Transactions on Neural Networks and Learning Systems, 2014
- Off-Policy Reinforcement Learning for $ H_\infty $ Control DesignIEEE Transactions on Cybernetics, 2014
- Integral reinforcement learning and experience replay for adaptive optimal control of partially-unknown constrained-input continuous-time systemsAutomatica, 2014
- A discrete-time parameter estimation based adaptive actuator failure compensation control schemeInternational Journal of Control, 2013
- Adaptive neural dynamic surface control for servo systems with unknown dead-zoneControl Engineering Practice, 2011
- Reinforcement Learning Controller Design for Affine Nonlinear Discrete-Time Systems using Online ApproximatorsIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2011
- A finite frequency domain approach to fault detection for linear discrete-time systemsInternational Journal of Control, 2008
- Adaptive NN control for a class of strict-feedback discrete-time nonlinear systemsAutomatica, 2003