Instance-Aware Exploration-Verification-Exploitation for Instance ImageGoal Navigation
Authors:
- 16 June 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 16329-16339
Abstract
As a new embodied vision task, Instance ImageGoal Navigation (IIN) aims to navigate to a specified object depicted by a goal image in an unexplored environment. The main challenge of this task lies in identifying the target object from different viewpoints while rejecting similar distractors. Existing ImageGoal Navigation methods usually adopt the simple Exploration-Exploitation framework and ignore the identification of specific instance during navigation. In this work, we propose to imitate the human behaviour of “getting closer to confirm” when distinguishing objects from a distance. Specifically, we design a new modular navigation framework named Instance-aware Exploration-Verification-Exploitation (IEVE) for instancelevel image goal navigation. Our method allows for active switching among the exploration, verification, and exploitation actions, thereby facilitating the agent in making reasonable decisions under different situations. On the challenging HabitatMatterport 3D semantic (HM3D-SEM) dataset, our method surpasses previous state-of-the-art work, with a classical segmentation model (0.684 vs. 0.561 success) or a robust model (0.702 vs. 0.561 success). Our code will be made publicly available at https://github.com/XiaohanLei/IEVE.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62102128,62021001)
This publication has 38 references indexed in Scilit:
- Zero Experience Required: Plug & Play Modular Transfer Learning for Semantic Visual Navigation2022
- Masked Autoencoders Are Scalable Vision Learners2022
- Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scale2022
- Learning Object Relation Graph and Tentative Policy for Visual Navigation2020
- Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environments2020
- Neural Topological SLAM for Visual Navigation2020
- Gibson Env: Real-World Perception for Embodied Agents2018
- Vision-and-Language Navigation: Interpreting Visually-Grounded Navigation Instructions in Real Environments2018
- Matterport3D: Learning from RGB-D Data in Indoor Environments2017
- ImageNet: A large-scale hierarchical image database2009