A Novel Multimodal Feature-Level Fusion Scheme for High-Accurate Indoor Localization
- 13 May 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 24 (12) , 19636-19646
Abstract
Smartphone based indoor localization has been widely explored to meet the demand for high-precision, cost-effective solutions within indoor positioning systems. Prior methodologies have predominantly concentrated on enhancing the localization accuracy inherent in single-sensor-based localization, thereby potentially constraining their applications. In this article, we introduce an innovative WiFi-visual multi-modal framework designed for achieving high-precision, low-cost indoor localization. The initial stages involve the utilization of two modal-specific encoders for feature extraction. Then, we propose a multi-modal fusion transformer to incorporate the global context and adopt element-wise summation to fuse the two deep features. Finally, we leverage a task-specific decoder for position prediction. During training, WiFi-aided learning is adopted to confer enhanced reliability to the labeling process. The efficacy of the proposed method is assessed in a corridor scenario and a laboratory scenario of a typical building. During testing, we propose backend optimization to get smooth and globally consistent location predictions. Experimental outcomes affirm that the proposed WiFi-visual multi-modal approach introduced herein attains a localization accuracy of less than half a meter, concurrently exhibiting commendable runtime efficiency.Keywords
Funding Information
- National Natural Science Foundation of China (62071284)
- National Key Research and Development Program of China (2022YFB2902304)
- Innovation Program of Shanghai Municipal Science and Technology Commission (20JC1416400, 21ZR1422400, 2051116603)
This publication has 29 references indexed in Scilit:
- SenseFi: A library and benchmark on deep-learning-empowered WiFi human sensingPatterns, 2023
- Multi-sensor information fusion based on machine learning for real applications in human activity recognition: State-of-the-art and research challengesInformation Fusion, 2022
- Multi-Modal Fusion Transformer for End-to-End Autonomous Driving2021
- LoFTR: Detector-Free Local Feature Matching with Transformers2021
- Fingerprinting-assisted UWB-based localization technique for complex indoor environmentsExpert Systems with Applications, 2021
- A Physics-Based Noise Formation Model for Extreme Low-Light Raw Denoising2020
- Smart Fusion of Multi-sensor Ubiquitous Signals of Mobile Device for Localization in GNSS-Denied ScenariosWireless Personal Communications, 2018
- Location based services: ongoing evolution and research agendaJournal of Location Based Services, 2018
- Optimum Array Processing2002
- Piecewise Linear Modeling and Analysis1998