FourierPlace: A Vision-Language Localization Framework Based on Frequency Domain Representations
- 19 November 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 11 (1) , 642-649
Abstract
Language-guided localization within 3D environments continues to pose a significant challenge for autonomous systems, primarily due to the need for precise alignment between sparse point cloud data and inherently ambiguous natural language descriptions. To address this, we present a novel vision-language localization framework, namely FourierPlace, that leverages frequency-domain representations to enhance the alignment of complex geometric features with imprecise linguistic cues. At the core of our approach is the Frequency Fusion Enhancement (FFE) module, which converts raw point cloud data into frequency-domain signals. Complementing this, the Fourier Gate Attention (FGA) mechanism operates on these frequency-domain features to strengthen cross-modal correspondence. Furthermore, we introduce the Hierarchical Language Understanding Network (HiLUNet), which progressively refines linguistic features through a multi-stage architecture. Additionally, the Multiscale Cascade Cross-Attention (MCCA) module incorporates geometric information at multiple scales in the fine stage. Experiments conducted on the KITTI360Pose benchmark demonstrate that FourierPlace achieves state-of-the-art performance, outperforming existing methods with 3.7% improvement in Top-1 coarse retrieval accuracy and 4.0% increase in Top-1 localization accuracy within a 15-meter threshold on the test set. Our proposed framework presents a robust and scalable solution for language-guided localization in large-scale autonomous applications, including delivery robotics and augmented reality (AR) navigation systems.Keywords
Funding Information
- Natural Science Foundation of Shandong Province (ZR2024QF284)
- Major Innovation Project of Qilu University of Technology (2025ZDZX03, 2025ZDZX04)
This publication has 35 references indexed in Scilit:
- Place recognition meet multiple modalities: a comprehensive review, current challenges and future developmentArtificial Intelligence Review, 2025
- SegPoint: Segment Any Point Cloud via Large Language Model2024
- CSPFormer: A cross-spatial pyramid transformer for visual place recognitionNeurocomputing, 2024
- Towards Cross-Modal Point Cloud Retrieval for Indoor Scenes2024
- SOE-Net: A Self-Attention and Orientation Encoding Network for Point Cloud based Place Recognition2021
- ScanRefer: 3D Object Localization in RGB-D Scans Using Natural Language2020
- ReferIt3D: Neural Listeners for Fine-Grained 3D Object Identification in Real-World Scenes2020
- DH3D: Deep Hierarchical 3D Descriptors for Robust Large-Scale 6DoF Relocalization2020
- PointNetVLAD: Deep Point Cloud Based Retrieval for Large-Scale Place Recognition2018
- NetVLAD: CNN Architecture for Weakly Supervised Place Recognition2016