IndustryNav: Exploring Spatial Reasoning of Embodied Agents in Dynamic Industrial Navigation
Preprint
Abstract
While Visual Large Language Models (VLLMs) show great promise as embodied agents, they continue to face substantial challenges in spatial reasoning. Existing embodied benchmarks largely focus on passive, static household environments and evaluate only isolated capabilities, failing to capture holistic performance in dynamic, real-world complexity. To fill this gap, we present IndustryNav, the first dynamic industrial navigation benchmark for active spatial reasoning. IndustryNav leverages 12 manually created, high-fidelity Unity warehouse scenarios featuring dynamic objects and human movement. Our evaluation employs a PointGoal navigation pipeline that effectively combines egocentric vision with global odometry to assess holistic local-global planning. Crucially, we introduce the "collision rate" and "warning rate" metrics to measure safety-oriented behaviors and distance estimation. A comprehensive study of nine state-of-the-art VLLMs (including models such as GPT-5-mini, Claude-4.5, and Gemini-2.5) reveals that closed-source models maintain a consistent advantage; however, all agents exhibit notable deficiencies in robust path planning, collision avoidance and active exploration. This highlights a critical need for embodied research to move beyond passive perception and toward tasks that demand stable planning, active exploration, and safe behavior in dynamic, real-world environment.Keywords
All Related Versions
This publication has 35 references indexed in Scilit:
- AutoTag & TagMap: LLM-Powered Moodle Plugins for Pedagogical Alignment ChecksSN Computer Science, 2025
- The rise and potential of large language model based agents: a surveyScience China Information Sciences, 2025
- BLINK: Multimodal Large Language Models Can See but Not Perceive2024
- Enhancing visualization and interaction of complex spatial data through augmented realityThe International Journal of Advanced Manufacturing Technology, 2024
- Neural Topological SLAM for Visual Navigation2020
- ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks2020
- REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environments2020
- Embodied Question Answering2018
- Vision-and-Language Navigation: Interpreting Visually-Grounded Navigation Instructions in Real Environments2018
- CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoning2017