HOSG-Nav: Hierarchical Open-Vocabulary Semantic Graph Navigation for Language-Guided Global Planning in 3D Gaussian Scenes
Open Access
- 19 May 2026
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 15 (10) , 2179
Abstract
Natural-language-driven robot navigation in complex indoor environments requires the joint capability of high-fidelity scene representation, structured semantic reasoning, and executable path planning. To address this challenge, this paper proposes HOSG-Nav, a unified framework for natural-language-driven global navigation that integrates open-vocabulary 3D Gaussian scene representation, hierarchical semantic scene graph construction, and large-language-model-driven planning. First, an open-vocabulary 3D Gaussian field is constructed to jointly encode scene geometry, appearance, and semantic information, where compressed CLIP features are lifted into continuous 3D space and depth supervision is introduced to enhance geometric stability and metric-scale consistency. Second, the optimized Gaussian primitives are further abstracted into a semantic scene graph with a region–object hierarchical structure and traversable topological relations to support structured environment understanding. Finally, for natural language instructions, hierarchical semantic parsing is performed with the assistance of a large language model, and executable global navigation paths are generated through cross-modal target retrieval and graph-search-based planning. Experimental results on the Replica dataset demonstrate that HOSG-Nav achieves competitive performance in scene representation, semantic target retrieval, and global navigation, validating the effectiveness of jointly integrating multimodal 3D representation, hierarchical semantic abstraction, and language-guided planning.Keywords
Funding Information
- Ministry of Science and Technology of the People's Republic of China (2021YFB1407000)
This publication has 65 references indexed in Scilit:
- CGS-SLAM: Compact 3D Gaussian Splatting for Dense Visual SLAM2025
- A Language-Driven Navigation Strategy Integrating Semantic Maps and Large Language Models2024
- A survey on occupancy perception for autonomous driving: The information fusion perspectiveInformation Fusion, 2024
- A Systematic Literature Review of A* PathfindingProcedia Computer Science, 2021
- QuadricSLAM: Dual Quadrics From Object Detections as Landmarks in Object-Oriented SLAMIEEE Robotics and Automation Letters, 2018
- Voxblox: Incremental 3D Euclidean Signed Distance Fields for on-board MAV planning2017
- Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image AnnotationsInternational Journal of Computer Vision, 2017
- OctoMap: an efficient probabilistic 3D mapping framework based on octreesAutonomous Robots, 2013
- Topological simultaneous localization and mapping (SLAM): toward exact localization without explicit localizationIEEE Transactions on Robotics and Automation, 2001
- Using occupancy grids for mobile robot perception and navigationComputer, 1989