Junhao Ren
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Junhao Ren has a total of 13 co-authors. Here are the top co-authors by number of shared publications:
- Gaoxi Xiao
Nanyang Technological University
5 shared publications Lan Zhao
3 shared publicationsHonglin Gao
2 shared publications- Honglin Gao2 shared publications
- Yajuan Sun
Singapore Institute of Manufacturing Technology (SIMTech), Agency for Science, Technology and Research (A*STAR), Singapore, Singapore
2 shared publications Aniq Ashan
1 shared publication
Latest Publications
- 21 August 2026
- Published by Elsevier in Applied Energy
- Vol. 426
Multi-agent reinforcement learning-based joint design of low-carbon P2P market and bidding strategy in microgrids
- 21 August 2026
- Published by Elsevier in Applied Energy
- Vol. 426
Multi-agent reinforcement learning-based joint design of low-carbon P2P market and bidding strategy in microgrids
- 19 June 2026
- Published by Elsevier in Knowledge-Based Systems
- Vol. 349
HeteroHBA: A generative structure-manipulating backdoor attack on heterogeneous graphs
- 19 June 2026
- Published by Elsevier in Knowledge-Based Systems
- Vol. 349
HeteroHBA: A generative structure-manipulating backdoor attack on heterogeneous graphs
- 26 May 2026
- Published by Elsevier in Neurocomputing
- Vol. 696
HeteroBA: A structure-manipulating backdoor attack on heterogeneous graphs
- 26 May 2026
- Published by Elsevier in Neurocomputing
- Vol. 696
HeteroBA: A structure-manipulating backdoor attack on heterogeneous graphs
- 25 November 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics: Systems
- Vol. 56 (2) , 920-932
Optimal Stochastic Containment Control of Discrete-Time Multiagent Systems With Process Disturbances
This article explores the optimal containment control of discrete-time multiagent systems (MASs) with the digraph and unknown dynamics under process disturbances. We first demonstrate, through a model transformation, that the mean square bounded containment of MASs can be achieved by guaranteeing the mean square boundedness of the containment error systems. Hence, we can transform the optimal stochastic containment control problem of MASs into a stochastic optimal control problem for containment error systems. Subsequently, utilizing the Bellman optimality principle and the stochastic Lyapunov equation (SLE), we design a model-based policy iteration (PI) algorithm for the optimal stochastic containment control of MASs. This model-based algorithm, by minimizing the cost function in linear quadratic form, enables MASs to achieve mean square bounded containment with the least possible energy input. To circumvent the dependency on the model information, we introduce an online model-free algorithm for the stochastic optimal control problem. The model-free algorithm is developed based on the Q-learning algorithm. Specifically, it uses a historical MAS trajectory to estimate the kernel matrix H of the Q function, enabling the resolution of the optimal stochastic containment control problem without model information. To realize the model-free algorithm, the LSTD estimator with bounded bias is employed in the policy evaluation step. We prove the equivalence between the model-free algorithm and the model-based algorithm. Finally, a numerical case is presented to demonstrate the efficacy of the proposed algorithms in achieving the optimal stochastic containment control of MASs.
- 25 November 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics: Systems
- Vol. 56 (2) , 920-932
Optimal Stochastic Containment Control of Discrete-Time Multiagent Systems With Process Disturbances
This article explores the optimal containment control of discrete-time multiagent systems (MASs) with the digraph and unknown dynamics under process disturbances. We first demonstrate, through a model transformation, that the mean square bounded containment of MASs can be achieved by guaranteeing the mean square boundedness of the containment error systems. Hence, we can transform the optimal stochastic containment control problem of MASs into a stochastic optimal control problem for containment error systems. Subsequently, utilizing the Bellman optimality principle and the stochastic Lyapunov equation (SLE), we design a model-based policy iteration (PI) algorithm for the optimal stochastic containment control of MASs. This model-based algorithm, by minimizing the cost function in linear quadratic form, enables MASs to achieve mean square bounded containment with the least possible energy input. To circumvent the dependency on the model information, we introduce an online model-free algorithm for the stochastic optimal control problem. The model-free algorithm is developed based on the Q-learning algorithm. Specifically, it uses a historical MAS trajectory to estimate the kernel matrix H of the Q function, enabling the resolution of the optimal stochastic containment control problem without model information. To realize the model-free algorithm, the LSTD estimator with bounded bias is employed in the policy evaluation step. We prove the equivalence between the model-free algorithm and the model-based algorithm. Finally, a numerical case is presented to demonstrate the efficacy of the proposed algorithms in achieving the optimal stochastic containment control of MASs.