HDPlanner: Advancing Autonomous Deployments in Unknown Environments Through Hierarchical Decision Networks
- 25 November 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 10 (1) , 256-263
Abstract
In this paper, we introduce HDPlanner, a deep reinforcement learning (DRL) based framework designed to tackle two core and challenging tasks for mobile robots: autonomous exploration and navigation, where the robot must optimize its trajectory adaptively to achieve the task objective through continuous interactions in unknown environments. Specifically, HDPlanner relies on novel hierarchical attention networks to empower the robot to reason about its belief across multiple spatial scales and sequence collaborative decisions, where our networks decompose long-term objectives into short-term informative task assignments and informative path plannings. We further propose a contrastive learning-based joint optimization to enhance the robustness of HDPlanner. We empirically demonstrate that HDPlanner significantly outperforms state-of-the-art conventional and learning-based baselines on an extensive set of simulations, including hundreds of test maps and large-scale, complex Gazebo environments. Notably, HDPlanner achieves real-time planning with travel distances reduced by up to ${35.7}{\%}$ compared to exploration benchmarks and by up to ${16.5}{\%}$ than navigation benchmarks. Furthermore, we validate our approach on hardware, where it generates high-quality, adaptive trajectories in both indoor and outdoor environments, highlighting its real-world applicability without additional training.Keywords
Funding Information
- Temasek Laboratories (TL/FS/2022/01, TL/FS/2024/01)
This publication has 35 references indexed in Scilit:
- Mapless Navigation among Dynamics with Social-safety-awareness: a reinforcement learning approach from 2D laser scans2020
- Motion Primitives-based Path Planning for Fast and Agile Exploration using Aerial Robots2020
- Falco: Fast likelihood‐based collision avoidance with extension to human‐guided navigationJournal of Field Robotics, 2020
- Deep Reinforcement Learning Supervised Autonomous Exploration in Office Environments2018
- From perception to decision: A data-driven approach to end-to-end motion planning for autonomous ground robots2017
- Receding Horizon "Next-Best-View" Planner for 3D Exploration2016
- Batch Informed Trees (BIT*): Sampling-based optimal planning via the heuristically guided search of implicit random geometric graphs2015
- OctoMap: an efficient probabilistic 3D mapping framework based on octreesAutonomous Robots, 2013
- A comparison of path planning strategies for autonomous exploration and mapping of unknown environmentsAutonomous Robots, 2012
- Lifelong Planning A∗Artificial Intelligence, 2004