Jin Ren
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Jin Ren has a total of 10 co-authors. Here are the top co-authors by number of shared publications:
- Ding Wang
Beijing University of Technology
8 shared publications - Junfei Qiao
Beijing University of Technology
8 shared publications - Mingming Zhao
School of Information Science and Technology, the Beijing Key Laboratory of Computational Intelligence and Intelligent System, the Beijing Laboratory of Smart Environmental Protection, and the Beijing Institute of Artificial Intelligence, Beijing University of Technology, Beijing, China
2 shared publications - Xin Li
School of Information Science and Technology, the Beijing Key Laboratory of Computational Intelligence and Intelligent System, the Beijing Institute of Artificial Intelligence, and the Beijing Laboratory of Smart Environmental Protection, Beijing University of Technology, Beijing, China
2 shared publications - Jiangyu Wang
Beijing University of Technology
1 shared publication - Lingzhi Hu
School of Information Science and Technology, Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing Laboratory of Smart Environmental Protection, and Beijing Institute of Artificial Intelligence, Beijing University of Technology, Beijing, China
1 shared publication
Latest Publications
- 25 February 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Informatics
- Vol. 22 (6) , 5565-5575
Multiagent Adaptive Critic Control With Expert Knowledge for Wastewater Treatment Plants
In this article, a multiagent adaptive critic control algorithm is developed for the multivariable control problem of wastewater treatment plants. The wastewater treatment plant is regarded as a type of decentralized interconnected system in this algorithm. To reduce the design difficulty of control strategies, multiple agents are created, and each agent is only responsible for optimizing the control strategy of a single subsystem. In addition, based on a well-designed Q-function, the agent considers the impact on other subsystems while optimizing its own control strategy. Therefore, the control algorithm exhibits good performance in both the implementation difficulty and the control accuracy. To ensure the initial performance of the control algorithm, the prior control strategy with expert knowledge is integrated into the control algorithm. Considering the disturbance factors in wastewater treatment plants, the direct control strategy is modified into an incremental control strategy, which improves the anti-interference performance of the control algorithm. The stability of the proposed algorithm is proved by constructing Lyapunov functions. The superiority of the control algorithm is verified through quantitative comparison results with other control algorithms.
- 25 February 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Informatics
- Vol. 22 (6) , 5565-5575
Multiagent Adaptive Critic Control With Expert Knowledge for Wastewater Treatment Plants
In this article, a multiagent adaptive critic control algorithm is developed for the multivariable control problem of wastewater treatment plants. The wastewater treatment plant is regarded as a type of decentralized interconnected system in this algorithm. To reduce the design difficulty of control strategies, multiple agents are created, and each agent is only responsible for optimizing the control strategy of a single subsystem. In addition, based on a well-designed Q-function, the agent considers the impact on other subsystems while optimizing its own control strategy. Therefore, the control algorithm exhibits good performance in both the implementation difficulty and the control accuracy. To ensure the initial performance of the control algorithm, the prior control strategy with expert knowledge is integrated into the control algorithm. Considering the disturbance factors in wastewater treatment plants, the direct control strategy is modified into an incremental control strategy, which improves the anti-interference performance of the control algorithm. The stability of the proposed algorithm is proved by constructing Lyapunov functions. The superiority of the control algorithm is verified through quantitative comparison results with other control algorithms.
- 19 February 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 23 (15455955) , 5869-5883
Incremental Q -Learning for Data-Driven Adaptive Critic Control of Wastewater Treatment Processes With State Constraints
With the widespread adoption of massive multiple-input multiple-output (MIMO) technology, itThe wastewater treatment process (WWTP) can effectively convert wastewater into reusable water, with dissolved oxygen (DO) concentration playing a crucial role in treatment efficiency. To achieve online control of DO concentration, a data-driven incremental Q-learning (IQL) method with utility reshaping is proposed. The core idea is to integrate the incremental information of control inputs, the norm value of tracking errors, and a control barrier function into the utility function. First, the IQL method designs an online controller by utilizing tracking errors and the incremental information of control inputs, which reduces the approximation pressure on neural networks caused by excessively large control inputs. Second, the IQL leverages the norm value of tracking errors to influence the magnitude of the incremental control inputs, thereby enhancing the adaptive capability and online stability. Third, an adjustable control barrier function is employed to ensure that the tracking errors do not exceed the predefined constraints, thus meeting the specified tracking accuracy requirements. Fourth, a stability criterion related to learning rates is established to demonstrate the convergence of neural network weights. Finally, the superior control performance of the IQL method is validated via simulation results under two distinct weather conditions.
- 19 February 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 23 (15455955) , 5869-5883
Incremental Q -Learning for Data-Driven Adaptive Critic Control of Wastewater Treatment Processes With State Constraints
With the widespread adoption of massive multiple-input multiple-output (MIMO) technology, itThe wastewater treatment process (WWTP) can effectively convert wastewater into reusable water, with dissolved oxygen (DO) concentration playing a crucial role in treatment efficiency. To achieve online control of DO concentration, a data-driven incremental Q-learning (IQL) method with utility reshaping is proposed. The core idea is to integrate the incremental information of control inputs, the norm value of tracking errors, and a control barrier function into the utility function. First, the IQL method designs an online controller by utilizing tracking errors and the incremental information of control inputs, which reduces the approximation pressure on neural networks caused by excessively large control inputs. Second, the IQL leverages the norm value of tracking errors to influence the magnitude of the incremental control inputs, thereby enhancing the adaptive capability and online stability. Third, an adjustable control barrier function is employed to ensure that the tracking errors do not exceed the predefined constraints, thus meeting the specified tracking accuracy requirements. Fourth, a stability criterion related to learning rates is established to demonstrate the convergence of neural network weights. Finally, the superior control performance of the IQL method is validated via simulation results under two distinct weather conditions.
- 30 September 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics: Systems
- Vol. 55 (12) , 8959-8970
Intelligent Critic Learning for Data-Driven Output Tracking Control With Lightweight Parallelization
This article investigates critical challenges in optimal output tracking control, including residual tracking errors, potential instability caused by discount factors, and premature convergence due to inefficient termination criteria. We tackle these issues by developing a data-driven parallel Q-learning algorithm. Specifically, a utility function directly linked to system states is proposed to avoid the instability and error amplification issues in traditional discounted approaches. In addition, the algorithm uses dual lightweight controllers that use convergence properties to enhance learning efficiency. Based on dual controllers, a novel termination criterion is introduced to prevent premature convergence during the training process. Numerical simulations demonstrate that the proposed method eliminates tracking errors, accelerates convergence compared with traditional algorithms, and ensures stable convergence across diverse system dynamics.
- 30 September 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics: Systems
- Vol. 55 (12) , 8959-8970
Intelligent Critic Learning for Data-Driven Output Tracking Control With Lightweight Parallelization
This article investigates critical challenges in optimal output tracking control, including residual tracking errors, potential instability caused by discount factors, and premature convergence due to inefficient termination criteria. We tackle these issues by developing a data-driven parallel Q-learning algorithm. Specifically, a utility function directly linked to system states is proposed to avoid the instability and error amplification issues in traditional discounted approaches. In addition, the algorithm uses dual lightweight controllers that use convergence properties to enhance learning efficiency. Based on dual controllers, a novel termination criterion is introduced to prevent premature convergence during the training process. Numerical simulations demonstrate that the proposed method eliminates tracking errors, accelerates convergence compared with traditional algorithms, and ensures stable convergence across diverse system dynamics.
- 11 June 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 36 (10) , 18653-18665
Online Self-Triggered Transmission Control With Critic Learning for Discrete Nonlinear Systems
In this article, a novel online self-triggered transmission control (STTC) framework is constructed based on the critic learning technique, which aims at tackling the optimal regulation issue of discrete-time nonlinear systems. On the premise of ensuring the system stability, a self-sampling function is designed only related to the sampling state, so that the next triggering moment can be determined. This not only effectively reduces the computational burden, but also avoids continuous judgment for the triggering condition similar to traditional event-based methods. Furthermore, the developed control method can be found to possess excellent triggering performance through theoretical analysis. Then, the model, critic, and action networks are established to execute the online critic learning algorithm, which make the control policy is adjusted in real-time to the optimal level. Finally, an experimental plant with nonlinear characteristics is given to illustrate the overall performance of the proposed online STTC method.
- 11 June 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 36 (10) , 18653-18665
Online Self-Triggered Transmission Control With Critic Learning for Discrete Nonlinear Systems
In this article, a novel online self-triggered transmission control (STTC) framework is constructed based on the critic learning technique, which aims at tackling the optimal regulation issue of discrete-time nonlinear systems. On the premise of ensuring the system stability, a self-sampling function is designed only related to the sampling state, so that the next triggering moment can be determined. This not only effectively reduces the computational burden, but also avoids continuous judgment for the triggering condition similar to traditional event-based methods. Furthermore, the developed control method can be found to possess excellent triggering performance through theoretical analysis. Then, the model, critic, and action networks are established to execute the online critic learning algorithm, which make the control policy is adjusted in real-time to the optimal level. Finally, an experimental plant with nonlinear characteristics is given to illustrate the overall performance of the proposed online STTC method.
- 3 January 2024
- Published by Wiley in International Journal of Robust and Nonlinear Control
- Vol. 34 (6) , 4112-4131
Improved value iteration for nonlinear tracking control with accelerated learning
In this article, an adaptive critic scheme with a novel performance index function is developed to solve the tracking control problem, which eliminates the tracking error and possesses the adjustable convergence rate in the offline learning process. Under some conditions, the convergence and monotonicity of the accelerated value function sequence can be guaranteed. Combining the advantages of the adjustable and general value iteration schemes, an integrated algorithm is proposed with a fast guaranteed convergence, which involves two stages, namely the acceleration stage and the convergence stage. Moreover, an effective approach is given to adaptively determine the acceleration interval. With this operation, the fast convergence of the new value iteration scheme can be fully utilized. Finally, compared with the general value iteration, the numerical results are presented to verify the fast convergence and the tracking performance of the developed adaptive critic design.
- 3 January 2024
- Published by Wiley in International Journal of Robust and Nonlinear Control
- Vol. 34 (6) , 4112-4131
Improved value iteration for nonlinear tracking control with accelerated learning
In this article, an adaptive critic scheme with a novel performance index function is developed to solve the tracking control problem, which eliminates the tracking error and possesses the adjustable convergence rate in the offline learning process. Under some conditions, the convergence and monotonicity of the accelerated value function sequence can be guaranteed. Combining the advantages of the adjustable and general value iteration schemes, an integrated algorithm is proposed with a fast guaranteed convergence, which involves two stages, namely the acceleration stage and the convergence stage. Moreover, an effective approach is given to adaptively determine the acceleration interval. With this operation, the fast convergence of the new value iteration scheme can be fully utilized. Finally, compared with the general value iteration, the numerical results are presented to verify the fast convergence and the tracking performance of the developed adaptive critic design.
- 23 February 2023
- Published by Wiley in International Journal of Robust and Nonlinear Control
- Vol. 33 (10) , 5365-5387
Event‐based robust performance guarantee for nonaffine plants via system identification
In this paper, by making use of recurrent neural networks (RNNs), a novel event‐based robust optimal controller is designed for a category of continuous‐time (CT) nonlinear nonaffine systems with disturbances. For tackling the optimal‐robust problem transformation and the performance guarantee, a system identifier is developed to reconstruct the system, and an event‐triggered critic‐only strategy is investigated to replace the traditional time‐based actor‐critic structure. The RNN is adopted to reconstruct the nonaffine system as an identifier for obtaining the affine model. It simplifies the system structure and reduces computational burdens. In addition, the stability of the unknown nominal system learned by the RNN is proved. Then, using the obtained system identifier and the adaptive critic learning structure, the proposed event‐triggered robust control with performance guarantee is realized. At last, the effectiveness of the given design method is verified by two simulation examples.
- 23 February 2023
- Published by Wiley in International Journal of Robust and Nonlinear Control
- Vol. 33 (10) , 5365-5387
Event‐based robust performance guarantee for nonaffine plants via system identification
In this paper, by making use of recurrent neural networks (RNNs), a novel event‐based robust optimal controller is designed for a category of continuous‐time (CT) nonlinear nonaffine systems with disturbances. For tackling the optimal‐robust problem transformation and the performance guarantee, a system identifier is developed to reconstruct the system, and an event‐triggered critic‐only strategy is investigated to replace the traditional time‐based actor‐critic structure. The RNN is adopted to reconstruct the nonaffine system as an identifier for obtaining the affine model. It simplifies the system structure and reduces computational burdens. In addition, the stability of the unknown nominal system learned by the RNN is proved. Then, using the obtained system identifier and the adaptive critic learning structure, the proposed event‐triggered robust control with performance guarantee is realized. At last, the effectiveness of the given design method is verified by two simulation examples.