Yizhuo Wang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Yizhuo Wang has a total of 10 co-authors. Here are the top co-authors by number of shared publications:
- Guillaume Sartoretti
National University of Singapore
2 shared publications - Yuhong Cao
Department of Mechanical Engineering, College of Design and Engineering, National University of Singapore, Singapore
2 shared publications - Bairan Xiang
Department of Mechanical Engineering, College of Design and Engineering, National University of Singapore, Singapore
1 shared publication Derek Ming Siang Tan
Department of Mechanical Engineering, College of Design and Engineering, National University of Singapore, Singapore
1 shared publication- Jimmy Chiun
Department of Mechanical Engineering, College of Design and Engineering, National University of Singapore, Singapore
1 shared publication - Jingsong Liang
Department of Mechanical Engineering, College of Design and Engineering, National University of Singapore, Singapore
1 shared publication
Latest Publications
- 1 July 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 11 (7) , 9016-9023
ORION: Option-Regularized Deep Reinforcement Learning for Cooperative Multi-Agent Online Navigation
- 1 July 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 11 (7) , 9016-9023
ORION: Option-Regularized Deep Reinforcement Learning for Cooperative Multi-Agent Online Navigation
- 20 March 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 9 (5) , 4631-4638
Deep Reinforcement Learning-Based Large-Scale Robot Exploration
In this work, we propose a deep reinforcement learning (DRL) based reactive planner to solve large-scale Lidar-based autonomous robot exploration problems in 2D action space. Our DRL-based planner allows the agent to reactively plan its exploration path by making implicit predictions about unknown areas, based on a learned estimation of the underlying transition model of the environment. To this end, our approach relies on learned attention mechanisms for their powerful ability to capture long-term dependencies at different spatial scales to reason about the robot's entire belief over known areas. Our approach relies on ground truth information (i.e., privileged learning) to guide the environment estimation during training, as well as on a graph rarefaction algorithm, which allows models trained in small-scale environments to scale to large-scale ones. Simulation results show that our model exhibits better exploration efficiency (12% in path length, 6% in makespan) and lower planning time (60%) than the state-of-the-art planners in a $\text{130}\;\text{m}\times \text{100}\,\text{m}$ benchmark scenario. We also validate our learned model on hardware.
- 20 March 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 9 (5) , 4631-4638
Deep Reinforcement Learning-Based Large-Scale Robot Exploration
In this work, we propose a deep reinforcement learning (DRL) based reactive planner to solve large-scale Lidar-based autonomous robot exploration problems in 2D action space. Our DRL-based planner allows the agent to reactively plan its exploration path by making implicit predictions about unknown areas, based on a learned estimation of the underlying transition model of the environment. To this end, our approach relies on learned attention mechanisms for their powerful ability to capture long-term dependencies at different spatial scales to reason about the robot's entire belief over known areas. Our approach relies on ground truth information (i.e., privileged learning) to guide the environment estimation during training, as well as on a graph rarefaction algorithm, which allows models trained in small-scale environments to scale to large-scale ones. Simulation results show that our model exhibits better exploration efficiency (12% in path length, 6% in makespan) and lower planning time (60%) than the state-of-the-art planners in a $\text{130}\;\text{m}\times \text{100}\,\text{m}$ benchmark scenario. We also validate our learned model on hardware.