Zhongqi Li
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Zhongqi Li has a total of 6 co-authors. Here are the top co-authors by number of shared publications:
- Huachuan Wang
Harbin Engineering University
1 shared publication - Jianxin Lin
Qingdao Innovation and Development Center of Harbin Engineering University, Qingdao, China
1 shared publication - Jihua Dou
Dalian Naval Academy, Dalian 116018, China
1 shared publication - Kunpeng Ouyang
College of Intelligent Systems Science and Engineering, Harbin Engineering University, Harbin 150001, China
1 shared publication - Weihao Xia
College of Intelligent Systems Science and Engineering, Harbin Engineering University, Harbin 150001, China
1 shared publication - Yuanhao Wang
College of Intelligent Systems Science and Engineering, Harbin Engineering University, Harbin 150001, China
1 shared publication
Latest Publications
- Open Access
- 8 December 2025
- Published by MDPI AG in Electronics
- Vol. 14 (24) , 4828
Risk-Aware Distributional Reinforcement Learning for Safe Path Planning of Surface Sensing Agents
In spatially constrained water domains, surface sensing agents(SSAs) must achieve safe path planning, uncertain currents, and sensor noise. We present a decentralized motion planning and collision-avoidance framework based on distributional reinforcement learning (DRL) that models the full return distribution to enable risk-aware decision making. Each surface sensing agent autonomously proceeds to its designated coordinates without rigid spatial constraints, coordinating implicitly through learned policies and a lightweight safety shield that enforces separation and kinematic limits. The method integrates (i) distributional value estimation for controllable risk sensitivity near hazards, (ii) domain randomization of sea states and disturbances for robustness, and (iii) a shielded action layer compatible with standard reactive rules (e.g., velocity obstacle-style constraints) to guarantee feasible maneuvers. In simulations across cluttered maps and stochastic current fields, the proposed approach improves success rates and reduces near-miss events compared to non-distributional RL and classical planners, while maintaining competitive path length and computation time. The results indicate that DRL-based surface sensing agent navigation is a practical path toward safe, efficient environmental monitoring and surveying.
- 8 December 2025
- Published by MDPI AG in Electronics
- Vol. 14 (24) , 4828
Open AccessRisk-Aware Distributional Reinforcement Learning for Safe Path Planning of Surface Sensing Agents
In spatially constrained water domains, surface sensing agents(SSAs) must achieve safe path planning, uncertain currents, and sensor noise. We present a decentralized motion planning and collision-avoidance framework based on distributional reinforcement learning (DRL) that models the full return distribution to enable risk-aware decision making. Each surface sensing agent autonomously proceeds to its designated coordinates without rigid spatial constraints, coordinating implicitly through learned policies and a lightweight safety shield that enforces separation and kinematic limits. The method integrates (i) distributional value estimation for controllable risk sensitivity near hazards, (ii) domain randomization of sea states and disturbances for robustness, and (iii) a shielded action layer compatible with standard reactive rules (e.g., velocity obstacle-style constraints) to guarantee feasible maneuvers. In simulations across cluttered maps and stochastic current fields, the proposed approach improves success rates and reduces near-miss events compared to non-distributional RL and classical planners, while maintaining competitive path length and computation time. The results indicate that DRL-based surface sensing agent navigation is a practical path toward safe, efficient environmental monitoring and surveying.