Resilient Indoor Localization System Based on UWB and Visual–Inertial Sensors for Complex Environments
- 2 August 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 70 (00189456) , 1-14
Abstract
In this article, a resilient tightly coupled ultra-wideband (UWB) visual–inertial indoor localization system (R-UVIS) is developed to obtain accurate and robust localization performance in complex scenes, even in the case when sensors fail. More specifically, three schemes are designed for the proposed system. First, we introduce the line and image patch features to improve the precision and robustness of the visual features. Besides, we propose accurate loop closure and relocalization methods based on multifeatures to improve the performance of the localization system. Second, we introduce the UWB sensor into the system to suppress the localization drifts in the complex scenes and provide a fixed reference frame. Third, we propose a resilient multisensor fusion method based on an optimization framework to fuse the UWB, visual and inertial measurements in a tightly coupled manner. This data fusion approach improves the robustness of the system, making the localization system seamlessly switch among different localization modes depending on the specific scenes. In addition, an initialization process along with three sensors is also designed for the whole system. We conduct extensive experiments on the public dataset and in real-world scenarios to evaluate the proposed R-UVIS. The experimental results show that the proposed R-UVIS can provide the accurate and robust localization results in a fixed coordinate system for the complicated indoor scenes, even in the case when visual tracking fails or the UWB anchors are unavailable.Keywords
Funding Information
- National Natural Science Foundation of China (51775110, 61703096)
- Startup Foundation for Introducing Talent of Nanjing University of Information Science and Technology (2021r041)
This publication has 36 references indexed in Scilit:
- The EuRoC micro aerial vehicle datasetsThe International Journal of Robotics Research, 2016
- On the performance of ConvNet features for place recognition2015
- Keyframe-based visual–inertial odometry using nonlinear optimizationThe International Journal of Robotics Research, 2014
- A LiDAR-Aided Indoor Navigation System for UGVsJournal of Navigation, 2014
- An efficient and robust line segment matching approach based on LBD descriptor and pairwise geometric consistencyJournal of Visual Communication and Image Representation, 2013
- High-precision, consistent EKF-based visual-inertial odometryThe International Journal of Robotics Research, 2013
- Observability-based Rules for Designing Consistent EKF SLAM EstimatorsThe International Journal of Robotics Research, 2009
- LSD: A Fast Line Segment Detector with a False Detection ControlIEEE Transactions on Pattern Analysis and Machine Intelligence, 2008
- A Multi-State Constraint Kalman Filter for Vision-aided Inertial NavigationProceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (cat. No.01ch37164), 2007
- Structure-from-motion using lines: Representation, triangulation, and bundle adjustmentComputer Vision and Image Understanding, 2005