Learning Causality-Aware Exploration with Transformers for Goal-Oriented Navigation
Open Access
- 20 March 2026
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Intelligent Systems and Technology
- Vol. 17 (3) , 1-26
Abstract
Navigation is a fundamental task in the research of Embodied AI, and recent advances in machine learning algorithms have garnered growing interest in developing versatile Embodied AI systems. However, current research in this domain reveals opportunities for improvement. First, the direct application of RNNs and Transformers often overlooks the distinct characteristics of navigation tasks compared to traditional sequential data modeling. These methods are inherently designed to capture long-term dependencies, which are relatively weak in navigation scenarios, potentially limiting their performance in such tasks. Second, the reliance on task-specific configurations, such as pre-trained modules and dataset-specific logic, compromises the generalizability of these methods. We address these constraints by initially exploring the unique differences between Navigation tasks and other sequential data tasks through the lens of Causality, presenting a causal framework to elucidate the inadequacies of conventional sequential methods for Navigation. By leveraging this causal perspective, we propose Causality-Aware Transformer (CAT) Networks for Navigation, featuring a Causal Understanding Module to enhance the model’s Environmental Understanding capability. Meanwhile, our method is devoid of task-specific inductive biases and can be trained in an End-to-End manner, which enhances the method’s generalizability across various contexts. Empirical evaluations demonstrate that our methodology consistently surpasses benchmark performances across a spectrum of settings, tasks, and simulation environments, specifically, in Object Navigation within RoboTHOR, Objective Navigation, Point Navigation in Habitat, and R2R Navigation. Extensive ablation studies reveal that the performance gains can be attributed to the Causal Understanding Module, which demonstrates effectiveness and efficiency in both Reinforcement Learning and Supervised Learning settings. Additionally, further analysis highlights the robustness of our method, demonstrating its capacity to consistently perform well across diverse experimental settings and varying conditions. This robustness underscores the adaptability and generalizability of our approach, reinforcing its potential for application across a wide range of tasks.Keywords
This publication has 35 references indexed in Scilit:
- Core Challenges in Embodied Vision-Language PlanningJournal of Artificial Intelligence Research, 2022
- A Survey of Embodied AI: From Simulators to Research TasksIEEE Transactions on Emerging Topics in Computational Intelligence, 2022
- Toward Causal Representation LearningProceedings of the IEEE, 2021
- RoboTHOR: An Open Simulation-to-Real Embodied AI Platform2020
- The Regretful Agent: Heuristic-Aided Navigation Through Progress Estimation2019
- Gibson Env: Real-World Perception for Embodied Agents2018
- Matterport3D: Learning from RGB-D Data in Indoor Environments2017
- Deep Residual Learning for Image Recognition2016
- Chapter 8 Markov decision processes1990
- Optimal control of Markov processes with incomplete state informationJournal of Mathematical Analysis and Applications, 1965