Lei Liu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Lei Liu has a total of 32 co-authors. Here are the top co-authors by number of shared publications:
- Dapeng Li
School of Electrical Engineering, Liaoning University of Technology, Jinzhou, Liaoning, China
2 shared publications - Dong-Juan Li
Liaoning University of Technology
2 shared publications - Huaguang Zhang
Northeastern University
2 shared publications - Peng Wang
Nanjing Normal University
2 shared publications - Qiuye Sun
Northeastern University
2 shared publications - Rui Wang
Northeastern University
2 shared publications
Latest Publications
- 3 September 2026
- Published by Taylor & Francis in Journal of the Chinese Institute of Engineers
- p. 1-13
Secure formation control for multi-UAV systems based on zero-sum game
1. In recent years, the secure formation control technology for multi-unmanned aerial vehicle systems has been commonly employed in various domains such as military reconnaissance (Stodola, Kozůbek...
- 3 September 2026
- Published by Taylor & Francis in Journal of the Chinese Institute of Engineers
- p. 1-13
Secure formation control for multi-UAV systems based on zero-sum game
1. In recent years, the secure formation control technology for multi-unmanned aerial vehicle systems has been commonly employed in various domains such as military reconnaissance (Stodola, Kozůbek...
- 2 March 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 23 (15455955) , 5664-5673
Fuzzy Neural Network-Based Multivariable Constrained Control for Wastewater Treatment Process With Actuator Failures
The wastewater treatment process (WWTP) operates under diverse conditions, and precise control of dissolved oxygen (DO) and nitrate nitrogen ( $\text {N}{{\text {O}}_{{3}}}\text {-N}$ ) concentrations is crucial for satisfying water quality standards. This paper proposes an adaptive fuzzy neural network (FNN) constrained control method based on an event-triggered mechanism. Firstly, the unknown nonlinear dynamic functions encountered in WWTP are effectively approximated using the FNN’s strong adaptive capability. Secondly, an event-triggered control (ETC) strategy is introduced to reduce the communication burden, with trigger conditions designed based on the control signal error. Subsequently, a time-varying asymmetric barrier Lyapunov function (BLF) is used to construct controllers for DO and $\text {N}{{\text {O}}_{{3}}}\text {-N}$ concentrations, ensuring variables remain within time-varying constraint ranges. Meanwhile, a fault-tolerant control (FTC) approach is introduced to cope with potential actuator failures during the WWTP. Finally, simulations using Benchmark Simulation Model 1 (BSM1) are performed to verify the effectiveness of the proposed method. Note to Practitioners—The wastewater treatment process (WWTP) is a typical complex industrial process characterized by strong non-linearities, large time delays, frequent disturbances, and multiple operating conditions. The inevitability of faults in aeration and reflux equipment, alongside stringent demands for resource efficiency, places heightened requirements on system stability and control precision. Considering communication resource constraints and equipment fault risks, the core control objective of this paper is to design a multivariable event-triggered constrained control method for WWTP under varying operating conditions, which aims to enhance operational performance while ensuring stable effluent quality that meets standards. Specifically, a mathematical model applicable to the WWTP is established, and a fuzzy neural network (FNN) is used in the controller to approximate unknown system dynamics and disturbances. Furthermore, a time-varying asymmetric barrier Lyapunov function (BLF) is introduced to mitigate process risks arising from excessive dissolved oxygen (DO) and nitrate nitrogen ( $\text {N}{{\text {O}}_{{3}}}\text {-N}$ ) concentrations, like microbial community instability and non-compliant effluent quality. However, with prolonged operation, critical equipment such as aeration blowers and internal recirculation pumps experience accelerated mechanical wear, including the performance degradation of fan blades and pump bearings. This paper employs an event-triggered mechanism to reduce high-frequency updates of control commands, enabling smoother operation of aeration and reflux equipment. This minimizes unnecessary operations, thereby lowering operation and maintenance costs and equipment failure risks. Finally, the effectiveness of the proposed constrained strategy is evaluated on a simulation platform for WWTP, and the results demonstrate a significant improvement in its operational performance.
- 2 March 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 23 (15455955) , 5664-5673
Fuzzy Neural Network-Based Multivariable Constrained Control for Wastewater Treatment Process With Actuator Failures
The wastewater treatment process (WWTP) operates under diverse conditions, and precise control of dissolved oxygen (DO) and nitrate nitrogen ( $\text {N}{{\text {O}}_{{3}}}\text {-N}$ ) concentrations is crucial for satisfying water quality standards. This paper proposes an adaptive fuzzy neural network (FNN) constrained control method based on an event-triggered mechanism. Firstly, the unknown nonlinear dynamic functions encountered in WWTP are effectively approximated using the FNN’s strong adaptive capability. Secondly, an event-triggered control (ETC) strategy is introduced to reduce the communication burden, with trigger conditions designed based on the control signal error. Subsequently, a time-varying asymmetric barrier Lyapunov function (BLF) is used to construct controllers for DO and $\text {N}{{\text {O}}_{{3}}}\text {-N}$ concentrations, ensuring variables remain within time-varying constraint ranges. Meanwhile, a fault-tolerant control (FTC) approach is introduced to cope with potential actuator failures during the WWTP. Finally, simulations using Benchmark Simulation Model 1 (BSM1) are performed to verify the effectiveness of the proposed method. Note to Practitioners—The wastewater treatment process (WWTP) is a typical complex industrial process characterized by strong non-linearities, large time delays, frequent disturbances, and multiple operating conditions. The inevitability of faults in aeration and reflux equipment, alongside stringent demands for resource efficiency, places heightened requirements on system stability and control precision. Considering communication resource constraints and equipment fault risks, the core control objective of this paper is to design a multivariable event-triggered constrained control method for WWTP under varying operating conditions, which aims to enhance operational performance while ensuring stable effluent quality that meets standards. Specifically, a mathematical model applicable to the WWTP is established, and a fuzzy neural network (FNN) is used in the controller to approximate unknown system dynamics and disturbances. Furthermore, a time-varying asymmetric barrier Lyapunov function (BLF) is introduced to mitigate process risks arising from excessive dissolved oxygen (DO) and nitrate nitrogen ( $\text {N}{{\text {O}}_{{3}}}\text {-N}$ ) concentrations, like microbial community instability and non-compliant effluent quality. However, with prolonged operation, critical equipment such as aeration blowers and internal recirculation pumps experience accelerated mechanical wear, including the performance degradation of fan blades and pump bearings. This paper employs an event-triggered mechanism to reduce high-frequency updates of control commands, enabling smoother operation of aeration and reflux equipment. This minimizes unnecessary operations, thereby lowering operation and maintenance costs and equipment failure risks. Finally, the effectiveness of the proposed constrained strategy is evaluated on a simulation platform for WWTP, and the results demonstrate a significant improvement in its operational performance.
- 13 November 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Informatics
- Vol. 22 (2) , 1347-1358
Reinforcement Learning-Based Adaptive Event-Triggered Control for Wastewater Treatment Process
To enhance the control effectiveness and operational efficiency of the wastewater treatment process (WWTP), this article proposes a multivariable optimal control scheme based on an identifier–critic–actor reinforcement learning (RL) framework with an event-triggered mechanism (ETM) for dissolved oxygen (DO) and nitrate nitrogen (NO) concentrations. First, the first fuzzy neural network (FNN) is used to estimate the unknown dynamics in WWTP, and the second FNN is implemented within the critic–actor optimization framework. Second, the RL algorithm is applied to design optimal controllers for DO and NO concentrations by constructing a tangent barrier Lyapunov function. Moreover, a dynamic ETM based on the adaptive threshold strategy is proposed to balance the control performance and energy consumption in the wastewater system. Finally, stability analysis and the benchmark simulation model no. 1 are conducted to verify that the control scheme proposed in this article demonstrates effectiveness and enhanced performance.
- 13 November 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Informatics
- Vol. 22 (2) , 1347-1358
Reinforcement Learning-Based Adaptive Event-Triggered Control for Wastewater Treatment Process
To enhance the control effectiveness and operational efficiency of the wastewater treatment process (WWTP), this article proposes a multivariable optimal control scheme based on an identifier–critic–actor reinforcement learning (RL) framework with an event-triggered mechanism (ETM) for dissolved oxygen (DO) and nitrate nitrogen (NO) concentrations. First, the first fuzzy neural network (FNN) is used to estimate the unknown dynamics in WWTP, and the second FNN is implemented within the critic–actor optimization framework. Second, the RL algorithm is applied to design optimal controllers for DO and NO concentrations by constructing a tangent barrier Lyapunov function. Moreover, a dynamic ETM based on the adaptive threshold strategy is proposed to balance the control performance and energy consumption in the wastewater system. Finally, stability analysis and the benchmark simulation model no. 1 are conducted to verify that the control scheme proposed in this article demonstrates effectiveness and enhanced performance.
- 8 September 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics: Systems
- Vol. 55 (11) , 8275-8288
Adaptive Intermittent and Optimal Control of Active Vehicle Suspension Systems With State-Dependent Constraints
This article proposes an adaptive intermittent control and an adaptive optimal control for quarter-vehicle active suspension systems. This article leverages integral-type barrier Lyapunov functions (BLFs) to ensure that the vertical displacement and vertical displacement velocity always satisfy state-related constraints. In order to stabilize the vehicle’s attitude and improve passenger comfort, an adaptive intermittent control method is designed to seek the dwell-time condition, achieving a balance between controllable and uncontrollable subsystems. In addition, to reduce the power consumption of the control input, an adaptive optimal control method is designed by designing optimal cost functions and employing the backstepping algorithm under the framework of actor–critic neural networks (critic NNs). The stability of the quarter-vehicle active suspension system is analyzed based on the Lyapunov theory. Finally, simulation results demonstrate significant effects on passenger comfort and reduced control input power for both control methods.
- 8 September 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics: Systems
- Vol. 55 (11) , 8275-8288
Adaptive Intermittent and Optimal Control of Active Vehicle Suspension Systems With State-Dependent Constraints
This article proposes an adaptive intermittent control and an adaptive optimal control for quarter-vehicle active suspension systems. This article leverages integral-type barrier Lyapunov functions (BLFs) to ensure that the vertical displacement and vertical displacement velocity always satisfy state-related constraints. In order to stabilize the vehicle’s attitude and improve passenger comfort, an adaptive intermittent control method is designed to seek the dwell-time condition, achieving a balance between controllable and uncontrollable subsystems. In addition, to reduce the power consumption of the control input, an adaptive optimal control method is designed by designing optimal cost functions and employing the backstepping algorithm under the framework of actor–critic neural networks (critic NNs). The stability of the quarter-vehicle active suspension system is analyzed based on the Lyapunov theory. Finally, simulation results demonstrate significant effects on passenger comfort and reduced control input power for both control methods.
- Open Access
Decentralized Sliding Mode Control for Large-Scale Systems with Actuator Failures Using Dynamic Event-Triggered Adaptive Dynamic Programming
This study develops a new integral sliding mode-based method to address the decentralized adaptive fault-tolerant guaranteed cost control (GCC) problem via a dynamic event-triggered (DET) adaptive dynamic programming (ADP) approach. Firstly, integral sliding mode control technology is applied to eliminate the influence of actuator faults, which can guarantee that the large-scale system states stay on the sliding mode surface. Secondly, the ADP algorithm based on DET mode is employed to improve the control performance for equivalent sliding mode surface and reduce computational and communication overhead. Meanwhile, the GCC method is introduced to ensure that the performance cost function is less than an upper bound while maintaining system stability. Then, through Lyapunov stability analysis, it is proven that the presented DET-GCC method based on ADP algorithm can guarantee that all signals are uniformly ultimately bounded. Finally, the validity of the developed approach is confirmed through the simulation results.
Open AccessDecentralized Sliding Mode Control for Large-Scale Systems with Actuator Failures Using Dynamic Event-Triggered Adaptive Dynamic Programming
This study develops a new integral sliding mode-based method to address the decentralized adaptive fault-tolerant guaranteed cost control (GCC) problem via a dynamic event-triggered (DET) adaptive dynamic programming (ADP) approach. Firstly, integral sliding mode control technology is applied to eliminate the influence of actuator faults, which can guarantee that the large-scale system states stay on the sliding mode surface. Secondly, the ADP algorithm based on DET mode is employed to improve the control performance for equivalent sliding mode surface and reduce computational and communication overhead. Meanwhile, the GCC method is introduced to ensure that the performance cost function is less than an upper bound while maintaining system stability. Then, through Lyapunov stability analysis, it is proven that the presented DET-GCC method based on ADP algorithm can guarantee that all signals are uniformly ultimately bounded. Finally, the validity of the developed approach is confirmed through the simulation results.
- Open Access
- 12 December 2024
- Published by MDPI AG in Mathematics
- Vol. 12 (24) , 3916
Integral Reinforcement Learning-Based Online Adaptive Dynamic Event-Triggered Control Design in Mixed Zero-Sum Games for Unknown Nonlinear Systems
Mixed zero-sum games consider both zero-sum and non-zero-sum differential game problems simultaneously. In this paper, multiplayer mixed zero-sum games (MZSGs) are studied by the means of an integral reinforcement learning (IRL) algorithm under the dynamic event-triggered control (DETC) mechanism for completely unknown nonlinear systems. Firstly, the adaptive dynamic programming (ADP)-based on-policy approach is proposed for solving the MZSG problem for the nonlinear system with multiple players. Secondly, to avoid using dynamic information of the system, a model-free control strategy is developed by utilizing actor–critic neural networks (NNs) for addressing the MZSG problem of unknown systems. On this basis, for the purpose of avoiding wasted communication and computing resources, the dynamic event-triggered mechanism is integrated into the integral reinforcement learning algorithm, in which a dynamic triggering condition is designed to further reduce triggering times. With the help of the Lyapunov stability theorem, the system states and weight values of NNs are proven to be uniformly ultimately bounded (UUB) stable. Finally, two examples are demonstrated to show the effectiveness and feasibility of the developed control method. Compared with static event-triggering mode, the simulation results show that the number of actuator updates in the DETC mechanism has been reduced by 55% and 69%, respectively.
- 12 December 2024
- Published by MDPI AG in Mathematics
- Vol. 12 (24) , 3916
Open AccessIntegral Reinforcement Learning-Based Online Adaptive Dynamic Event-Triggered Control Design in Mixed Zero-Sum Games for Unknown Nonlinear Systems
Mixed zero-sum games consider both zero-sum and non-zero-sum differential game problems simultaneously. In this paper, multiplayer mixed zero-sum games (MZSGs) are studied by the means of an integral reinforcement learning (IRL) algorithm under the dynamic event-triggered control (DETC) mechanism for completely unknown nonlinear systems. Firstly, the adaptive dynamic programming (ADP)-based on-policy approach is proposed for solving the MZSG problem for the nonlinear system with multiple players. Secondly, to avoid using dynamic information of the system, a model-free control strategy is developed by utilizing actor–critic neural networks (NNs) for addressing the MZSG problem of unknown systems. On this basis, for the purpose of avoiding wasted communication and computing resources, the dynamic event-triggered mechanism is integrated into the integral reinforcement learning algorithm, in which a dynamic triggering condition is designed to further reduce triggering times. With the help of the Lyapunov stability theorem, the system states and weight values of NNs are proven to be uniformly ultimately bounded (UUB) stable. Finally, two examples are demonstrated to show the effectiveness and feasibility of the developed control method. Compared with static event-triggering mode, the simulation results show that the number of actuator updates in the DETC mechanism has been reduced by 55% and 69%, respectively.
- 31 May 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics: Systems
- Vol. 53 (9) , 5933-5944
Communication-Free Voltage-Regulation and Current-Sharing for DC Microgrids: An Intelligent Edge Control
Though voltage-regulation and current-sharing of distributed generations (DGs) in dc-microgrids have been widely studied, additional communication links or independent modulation circuit should be added to achieve information transmission. To accomplish precise current-sharing/voltage-regulation without additional communication devices, this article proposes a communication-free intelligent edge control regarding voltage and current for dc-microgrids. First, the power-information dual modulation (PIDM) is designed to achieve information exchange among DGs and eliminate additional communication devices. Second, the cooperative control problem with two coupled targets, i.e., accurate voltage-regulation and current-sharing, is converted into a matter of optimal control. Therefore, the voltage-regulation and current-sharing could be solved concurrently. In addition, the control objective function of each DG is switched to provide the optimal controller and minimize the voltage/current control deviation, which is further switched to solve the Hamilton–Jacobi–Bellman (HJB) function. In order to solve this HJB function, which is difficult to obtain analytical solution, an intelligent edge control strategy with PIDM is proposed to solve the HJB function. Therefore, the precise voltage-regulation and current-sharing can be accomplished. Finally, the proposed control approach is verified through simulation results.
- 31 May 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics: Systems
- Vol. 53 (9) , 5933-5944
Communication-Free Voltage-Regulation and Current-Sharing for DC Microgrids: An Intelligent Edge Control
Though voltage-regulation and current-sharing of distributed generations (DGs) in dc-microgrids have been widely studied, additional communication links or independent modulation circuit should be added to achieve information transmission. To accomplish precise current-sharing/voltage-regulation without additional communication devices, this article proposes a communication-free intelligent edge control regarding voltage and current for dc-microgrids. First, the power-information dual modulation (PIDM) is designed to achieve information exchange among DGs and eliminate additional communication devices. Second, the cooperative control problem with two coupled targets, i.e., accurate voltage-regulation and current-sharing, is converted into a matter of optimal control. Therefore, the voltage-regulation and current-sharing could be solved concurrently. In addition, the control objective function of each DG is switched to provide the optimal controller and minimize the voltage/current control deviation, which is further switched to solve the Hamilton–Jacobi–Bellman (HJB) function. In order to solve this HJB function, which is difficult to obtain analytical solution, an intelligent edge control strategy with PIDM is proposed to solve the HJB function. Therefore, the precise voltage-regulation and current-sharing can be accomplished. Finally, the proposed control approach is verified through simulation results.
- Open Access
- 5 October 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems I: Regular Papers
- Vol. 69 (2) , 946-955
Stability-Oriented Minimum Switching/Sampling Frequency for Cyber-Physical Systems: Grid-Connected Inverters Under Weak Grid
Although the cyber-physical system stability is widely studied, scholars focus more on system stability with communication time delay. Therein, grid-connected inverters with the digital control system are regarded as one simplest and typical cyber-physical system. Meanwhile, the switching/sampling frequency of the inverter is always selected as low as possible from an efficiency viewpoint, resulting in unavoidable delay time. This delay time is apt to cause the system instability, which is more prone to severity under weak grid. To this end, this paper provides a minimum switching/sampling frequency for grid-connected inverters. Firstly, the system impedance model with equivalent delay time is constructed, which is based on padé approximate approach. This equivalent delay time consists of three parts, i.e., sampling delay time in cyber/physical level, calculation delay time in cyber level and pulsewidth modulation delay time in physical level, which reflects the cyber-physical interaction impact. Furthermore, the stability forbidden criterion is applied to make the switching/sampling frequency solving process become Hurwitz matrix identification problem through space mappings. Based on these space mappings, an adaptive step search approach is adopted to obtain the minimum switching/sampling frequency. Finally, the proposed approach can well evaluate the system stability under different frequencies through simulation and experiment.
- 5 October 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems I: Regular Papers
- Vol. 69 (2) , 946-955
Open AccessStability-Oriented Minimum Switching/Sampling Frequency for Cyber-Physical Systems: Grid-Connected Inverters Under Weak Grid
Although the cyber-physical system stability is widely studied, scholars focus more on system stability with communication time delay. Therein, grid-connected inverters with the digital control system are regarded as one simplest and typical cyber-physical system. Meanwhile, the switching/sampling frequency of the inverter is always selected as low as possible from an efficiency viewpoint, resulting in unavoidable delay time. This delay time is apt to cause the system instability, which is more prone to severity under weak grid. To this end, this paper provides a minimum switching/sampling frequency for grid-connected inverters. Firstly, the system impedance model with equivalent delay time is constructed, which is based on padé approximate approach. This equivalent delay time consists of three parts, i.e., sampling delay time in cyber/physical level, calculation delay time in cyber level and pulsewidth modulation delay time in physical level, which reflects the cyber-physical interaction impact. Furthermore, the stability forbidden criterion is applied to make the switching/sampling frequency solving process become Hurwitz matrix identification problem through space mappings. Based on these space mappings, an adaptive step search approach is adopted to obtain the minimum switching/sampling frequency. Finally, the proposed approach can well evaluate the system stability under different frequencies through simulation and experiment.