Hui Zhang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Hui Zhang has a total of 7 co-authors. Here are the top co-authors by number of shared publications:
- Chenghao Shi
College of Intelligence Science and Technology, National University of Defense Technology, Changsha 410073, China
1 shared publication - Huimin Lu
National University of Defense Technology
1 shared publication - Pengming Zhu
College of Intelligence Science and Technology, National University of Defense Technology, Changsha, China
1 shared publication - Shaowu Yang
Department of Automatic Control, College of Mechatronics Engineering and Automation, National University of Defense Technology, Changsha, China
1 shared publication - Zhiqiang Zheng
College of Mechatronics and Automation National University of Defense Technology 410073 China
1 shared publication - Zhiwen Zeng
College of Intelligence Science and Technology National University of Defense Technology 410073 Changsha China
1 shared publication
Latest Publications
- Open Access
- 7 September 2021
- Published by MDPI AG in Applied Sciences
- Vol. 11 (18) , 8299
Autonomous Exploration of Mobile Robots via Deep Reinforcement Learning Based on Spatiotemporal Information on Graph
In this paper, we address the problem of autonomous exploration in unknown environments for ground mobile robots with deep reinforcement learning (DRL). To effectively explore unknown environments, we construct an exploration graph considering historical trajectories, frontier waypoints, landmarks, and obstacles. Meanwhile, to take full advantage of the spatiotemporal feature and historical information in the autonomous exploration task, we propose a novel network called Spatiotemporal Neural Network on Graph (Graph-STNN). Specifically, the proposed Graph-STNN extracts the spatial feature using graph convolutional network (GCN) and the temporal feature using temporal convolutional network (TCN). Then, gated recurrent unit (GRU) is performed to synthesize the spatial feature, the temporal feature, and the historical state information into the current state feature. Combined with DRL, our Graph-STNN helps estimation of the optimal target point through extracted hybrid features. The simulation experiment shows that our approach is more effective than the GCN-based approach and the information entropy-based approach. Moreover, Graph-STNN also performs better generalization ability than GCN-based, information entropy-based, and random methods. Finally, we validate our approach on the simulation platform Stage with the actual robot model.
- 7 September 2021
- Published by MDPI AG in Applied Sciences
- Vol. 11 (18) , 8299
Open AccessAutonomous Exploration of Mobile Robots via Deep Reinforcement Learning Based on Spatiotemporal Information on Graph
In this paper, we address the problem of autonomous exploration in unknown environments for ground mobile robots with deep reinforcement learning (DRL). To effectively explore unknown environments, we construct an exploration graph considering historical trajectories, frontier waypoints, landmarks, and obstacles. Meanwhile, to take full advantage of the spatiotemporal feature and historical information in the autonomous exploration task, we propose a novel network called Spatiotemporal Neural Network on Graph (Graph-STNN). Specifically, the proposed Graph-STNN extracts the spatial feature using graph convolutional network (GCN) and the temporal feature using temporal convolutional network (TCN). Then, gated recurrent unit (GRU) is performed to synthesize the spatial feature, the temporal feature, and the historical state information into the current state feature. Combined with DRL, our Graph-STNN helps estimation of the optimal target point through extracted hybrid features. The simulation experiment shows that our approach is more effective than the GCN-based approach and the information entropy-based approach. Moreover, Graph-STNN also performs better generalization ability than GCN-based, information entropy-based, and random methods. Finally, we validate our approach on the simulation platform Stage with the actual robot model.
- 18 July 2010
- Published by Elsevier in Mechatronics
- Vol. 21 (2) , 373-389
A robust omnidirectional vision sensor for soccer robots
- 18 July 2010
- Published by Elsevier in Mechatronics
- Vol. 21 (2) , 373-389
A robust omnidirectional vision sensor for soccer robots