Learning Heuristics for Efficient Environment Exploration Using Graph Neural Networks
Authors:
- 5 December 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 86-93
Abstract
The robot exploration problem focuses on maximizing the volumetric map of a previously unknown environment. This is a relevant problem in several applications, such as search and rescue and monitoring, which require autonomous robots to examine the surroundings efficiently. Graph-based planning approaches embed the exploration information into a graph describing the global map while the robot incrementally builds it. Nevertheless, even if graph-based representations are computational and memory-efficient, the exploration decision-making problem complexity increases according to the graph size that grows at each iteration. In this paper, we propose a novel Graph Neural Network (GNN) approach trained with Reinforcement Learning (RL) that solves the decision-making problem for autonomous exploration. The learned policy represents the exploration expansion criterion, solving the decision-making problem efficiently and generalizing to different graph topologies and, consequently, environments. We validate the proposed approach with an aerial robot equipped with a depth camera in a benchmark exploration scenario using a high-performance physics engine for environment rendering. We compare the results against a state-of-the-art planning exploration algorithm, showing that the proposed approach matches its performance in terms of explored mapped volume. Additionally, our approach consistently maintains its performance regardless of the objective function used to explore the environment.Keywords
This publication has 37 references indexed in Scilit:
- Auxiliary Tasks and Exploration Enable ObjectGoal Navigation2021
- Autonomous navigation of MAVs in unknown cluttered environmentsJournal of Field Robotics, 2020
- Surface-Based Exploration for Autonomous 3D Modeling2018
- Autonomous exploration and simultaneous object search using aerial robots2018
- Online informative path planning for active classification using UAVs2017
- Receding Horizon "Next-Best-View" Planner for 3D Exploration2016
- RotorS—A Modular Gazebo MAV Simulator Framework2016
- A comparison of path planning strategies for autonomous exploration and mapping of unknown environmentsAutonomous Robots, 2012
- Modelling Navigational Knowledge by Route Graphs2000
- Simple statistical gradient-following algorithms for connectionist reinforcement learningMachine Learning, 1992