Xin Li
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Xin Li has a total of 9 co-authors. Here are the top co-authors by number of shared publications:
- Ding Wang
Beijing University of Technology
7 shared publications - Junfei Qiao
Beijing University of Technology
7 shared publications - Hua Wang
School of Computer Science and Artificial Intelligence, Zhengzhou University, Zhengzhou, China
2 shared publications - Jin Ren
School of Information Science and Technology, Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing Laboratory of Smart Environmental Protection, and Beijing Institute of Artificial Intelligence, Beijing University of Technology, Beijing, China
2 shared publications Ao Liu
School of Information Science and Technology, the Beijing Key Laboratory of Computational Intelligence and Intelligent System, the Beijing Institute of Artificial Intelligence, and the Beijing Laboratory of Smart Environmental Protection, Beijing University of Technology, Beijing, China
1 shared publicationKai Ye
School of Information Science and Technology, Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing Laboratory of Smart Environmental Protection, and Beijing Institute of Artificial Intelligence, Beijing University of Technology, Beijing, China
1 shared publication
Latest Publications
- 25 February 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Informatics
- Vol. 22 (6) , 5565-5575
Multiagent Adaptive Critic Control With Expert Knowledge for Wastewater Treatment Plants
In this article, a multiagent adaptive critic control algorithm is developed for the multivariable control problem of wastewater treatment plants. The wastewater treatment plant is regarded as a type of decentralized interconnected system in this algorithm. To reduce the design difficulty of control strategies, multiple agents are created, and each agent is only responsible for optimizing the control strategy of a single subsystem. In addition, based on a well-designed Q-function, the agent considers the impact on other subsystems while optimizing its own control strategy. Therefore, the control algorithm exhibits good performance in both the implementation difficulty and the control accuracy. To ensure the initial performance of the control algorithm, the prior control strategy with expert knowledge is integrated into the control algorithm. Considering the disturbance factors in wastewater treatment plants, the direct control strategy is modified into an incremental control strategy, which improves the anti-interference performance of the control algorithm. The stability of the proposed algorithm is proved by constructing Lyapunov functions. The superiority of the control algorithm is verified through quantitative comparison results with other control algorithms.
- 25 February 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Informatics
- Vol. 22 (6) , 5565-5575
Multiagent Adaptive Critic Control With Expert Knowledge for Wastewater Treatment Plants
In this article, a multiagent adaptive critic control algorithm is developed for the multivariable control problem of wastewater treatment plants. The wastewater treatment plant is regarded as a type of decentralized interconnected system in this algorithm. To reduce the design difficulty of control strategies, multiple agents are created, and each agent is only responsible for optimizing the control strategy of a single subsystem. In addition, based on a well-designed Q-function, the agent considers the impact on other subsystems while optimizing its own control strategy. Therefore, the control algorithm exhibits good performance in both the implementation difficulty and the control accuracy. To ensure the initial performance of the control algorithm, the prior control strategy with expert knowledge is integrated into the control algorithm. Considering the disturbance factors in wastewater treatment plants, the direct control strategy is modified into an incremental control strategy, which improves the anti-interference performance of the control algorithm. The stability of the proposed algorithm is proved by constructing Lyapunov functions. The superiority of the control algorithm is verified through quantitative comparison results with other control algorithms.
- 19 December 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cybernetics
- Vol. 56 (4) , 2340-2353
Event-Triggered Safe Critic Learning Control via Swarm Intelligence Optimization
This article develops an event-triggered safe critic learning control (ESCLC) algorithm for nonlinear systems subject to asymmetric state constraints by integrating a safe critic learning control (SCLC) framework with an event-triggering mechanism. The SCLC algorithm innovatively incorporates control barrier functions into the safe value function design, addressing the challenge of deriving optimal control policies that guarantee system safety. Convergence of the SCLC algorithm is rigorously established within the value iteration framework, along with a criterion for assessing the admissibility of control policies. To enhance the application value of the algorithm in resource-constrained scenarios, an event-triggering mechanism is incorporated into the SCLC framework, yielding the ESCLC algorithm. The resulting closed-loop system under the ESCLC algorithm is proved to be asymptotically stable, and an upper bound on the actual value function is derived to ensure bounded performance degradation. In addition, a policy improvement method based on particle swarm optimization is designed that eliminates dependence on the system control matrix. Finally, the effectiveness of the ESCLC algorithm is verified through simulation experiments on a torsion pendulum system and a ball-and-beam system.
- 19 December 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cybernetics
- Vol. 56 (4) , 2340-2353
Event-Triggered Safe Critic Learning Control via Swarm Intelligence Optimization
This article develops an event-triggered safe critic learning control (ESCLC) algorithm for nonlinear systems subject to asymmetric state constraints by integrating a safe critic learning control (SCLC) framework with an event-triggering mechanism. The SCLC algorithm innovatively incorporates control barrier functions into the safe value function design, addressing the challenge of deriving optimal control policies that guarantee system safety. Convergence of the SCLC algorithm is rigorously established within the value iteration framework, along with a criterion for assessing the admissibility of control policies. To enhance the application value of the algorithm in resource-constrained scenarios, an event-triggering mechanism is incorporated into the SCLC framework, yielding the ESCLC algorithm. The resulting closed-loop system under the ESCLC algorithm is proved to be asymptotically stable, and an upper bound on the actual value function is derived to ensure bounded performance degradation. In addition, a policy improvement method based on particle swarm optimization is designed that eliminates dependence on the system control matrix. Finally, the effectiveness of the ESCLC algorithm is verified through simulation experiments on a torsion pendulum system and a ball-and-beam system.
- 30 October 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 22 (15455955) , 23379-23392
Safe Optimal Tracking Control via Multi-Step Critic Learning for Unknown Nonlinear Systems
For unknown nonlinear systems, a safe optimal tracking control algorithm is developed based on multi-step critic learning. By integrating the control barrier function into the critic learning framework, the algorithm ensures that the tracking error is kept within a safe region and converges to zero with the minimal cost. Utilizing historical operational data of the system, a model network is established to identify the unknown system dynamics. By constructing feedforward control, the tracking problem of the original system is transformed into a regulation problem of the error system. To enhance the convergence speed of the algorithm, a critic learning framework with multi-step policy evaluation is designed. Furthermore, a criterion is developed to determine the admissibility of the safe tracking control policy at each iteration step. The convergence of the proposed algorithm is also proved. Finally, the simulation results demonstrate effectiveness of the algorithm and the validity of the theoretical results.
- 30 October 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 22 (15455955) , 23379-23392
Safe Optimal Tracking Control via Multi-Step Critic Learning for Unknown Nonlinear Systems
For unknown nonlinear systems, a safe optimal tracking control algorithm is developed based on multi-step critic learning. By integrating the control barrier function into the critic learning framework, the algorithm ensures that the tracking error is kept within a safe region and converges to zero with the minimal cost. Utilizing historical operational data of the system, a model network is established to identify the unknown system dynamics. By constructing feedforward control, the tracking problem of the original system is transformed into a regulation problem of the error system. To enhance the convergence speed of the algorithm, a critic learning framework with multi-step policy evaluation is designed. Furthermore, a criterion is developed to determine the admissibility of the safe tracking control policy at each iteration step. The convergence of the proposed algorithm is also proved. Finally, the simulation results demonstrate effectiveness of the algorithm and the validity of the theoretical results.
- 14 October 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 22 (15455955) , 22796-22806
Intelligent Critic Design With Policy Transfer for Wastewater Treatment Processes
Wastewater treatment plays a meaningful role in environmental protection, water recycling and public health, and its optimal control offers significant economic and social value. However, the wastewater treatment plant is a large-scale nonlinear system, and its own operation is affected by a series of uncontrollable factors such as the flow rate and composition of the incoming wastewater. This makes it extremely challenging for traditional control methods to realize precise control. To address these issues, this paper proposes a novel knowledge-guided policy optimization control method by integrating policy transfer and adaptive dynamic programming. First, an adaptive critic policy transfer framework based on the source domain knowledge selection method is introduced to construct knowledge extraction and data mining structures to enhance the learning efficiency of the target domain agent. Second, a source domain knowledge selection module is proposed to adaptively adjust the knowledge extracted by the target domain agent. Third, an adaptive termination module is designed to determine when the immature policy in the source domain should terminate during the target domain learning process. Finally, the theoretical stability of the method in this paper is demonstrated by designing a reasonable Lyapunov function. The system performance of the wastewater treatment plant under dry, rainy, and stormy weather conditions is evaluated, ultimately demonstrating the superior performance and adaptability of the proposed method.
- 14 October 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 22 (15455955) , 22796-22806
Intelligent Critic Design With Policy Transfer for Wastewater Treatment Processes
Wastewater treatment plays a meaningful role in environmental protection, water recycling and public health, and its optimal control offers significant economic and social value. However, the wastewater treatment plant is a large-scale nonlinear system, and its own operation is affected by a series of uncontrollable factors such as the flow rate and composition of the incoming wastewater. This makes it extremely challenging for traditional control methods to realize precise control. To address these issues, this paper proposes a novel knowledge-guided policy optimization control method by integrating policy transfer and adaptive dynamic programming. First, an adaptive critic policy transfer framework based on the source domain knowledge selection method is introduced to construct knowledge extraction and data mining structures to enhance the learning efficiency of the target domain agent. Second, a source domain knowledge selection module is proposed to adaptively adjust the knowledge extracted by the target domain agent. Third, an adaptive termination module is designed to determine when the immature policy in the source domain should terminate during the target domain learning process. Finally, the theoretical stability of the method in this paper is demonstrated by designing a reasonable Lyapunov function. The system performance of the wastewater treatment plant under dry, rainy, and stormy weather conditions is evaluated, ultimately demonstrating the superior performance and adaptability of the proposed method.
- 29 September 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Informatics
- Vol. 22 (1) , 407-417
Incremental Critic Learning Control With Policy Transfer for Wastewater Treatment Processes
Regarding the control of dissolved oxygen concentration in wastewater treatment plants (WWTPs), the direct control policies in conventional critic learning control algorithms often exhibit high sensitivity to system disturbances, which may potentially causing significant degradation in control performance. To address this limitation, a transferable incremental critic learning control (TICLC) algorithm is developed, reformulating the control policy into an incremental form. Furthermore, the historical operation data of WWTPs is leveraged to enable policy transfer across different control methods, which effectively improves the control performance of the TICLC algorithm during the initial learning phase. In addition, a novel utility function incorporating a soft policy constraint mechanism is designed to enhance the stability of the TICLC algorithm during the online optimization. The stability of the TICLC algorithm is proved by constructing a Lyapunov function. Experimental results derived from the benchmark simulation model no. 1 show that the TICLC algorithm achieves superior control performance for the dissolved oxygen concentration in WWTPs.
- 29 September 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Informatics
- Vol. 22 (1) , 407-417
Incremental Critic Learning Control With Policy Transfer for Wastewater Treatment Processes
Regarding the control of dissolved oxygen concentration in wastewater treatment plants (WWTPs), the direct control policies in conventional critic learning control algorithms often exhibit high sensitivity to system disturbances, which may potentially causing significant degradation in control performance. To address this limitation, a transferable incremental critic learning control (TICLC) algorithm is developed, reformulating the control policy into an incremental form. Furthermore, the historical operation data of WWTPs is leveraged to enable policy transfer across different control methods, which effectively improves the control performance of the TICLC algorithm during the initial learning phase. In addition, a novel utility function incorporating a soft policy constraint mechanism is designed to enhance the stability of the TICLC algorithm during the online optimization. The stability of the TICLC algorithm is proved by constructing a Lyapunov function. Experimental results derived from the benchmark simulation model no. 1 show that the TICLC algorithm achieves superior control performance for the dissolved oxygen concentration in WWTPs.