R²-GVIO: A Robust, Real-Time GNSS-Visual-Inertial State Estimator in Urban Challenging Environments
- 20 March 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 11 (12) , 22269-22282
Abstract
Visual-inertial odometry (VIO) often suffers from drifting, particularly in large-scale environments. Concurrently, the global navigation satellite system (GNSS) signals will be intermittent or even inaccessible in obstructed environments. In this work, we present a robust, real-time GNSS-visual-inertial state estimator, abbreviated as R2-GVIO, that achieves drift-free six-degree-of-freedom accurate global positioning in urban challenging environments. Specifically, we integrate GNSS into the optimization-based monocular and stereo VIO, enabling the fusion of GNSS real-time kinematic (RTK), reprojection error, and inertial measurement unit (IMU) preintegration within a factor graph framework. In addition, to enhance the R2-GVIO’s robustness in GNSS-unfriendly environments, we propose an online GNSS measurement outlier detection and culling algorithm based on velocity constraints and a time synchronization mechanism. Furthermore, we propose a GNSS-aided initialization method that provides accurate gravity direction, IMU zero bias, and local–global external parameters. Moreover, we adopt the marginalization strategy of covisibility graph keyframes (KFs) and add the GNSS factor constraint on the covisibility KFs pose, ensuring the real-time performance of the system. Experiments on public data sets and real-world experiments verify that in challenging environments, including urban canyons, complex indoor–outdoor, and large-scale environments, the positioning accuracy and robustness of the proposed R2-GVIO algorithm are superior to the state-of-the-art algorithms VINS-Fusion, ORB-SLAM3, IC-GVINS, and GICI-LIB. To make contribute to the community, we open sourced the complex environment data sets https://github.com/SYSU-CPNTLab/SYSU-Campus-GVI-Dataset (“SYSU-Campus-GVI” on GitHub).Keywords
Funding Information
- Project funded by China Postdoc-toral Science Foundation (2023M744096)
- National Funded Postdoctoral Researcher Program (GZC20233208)
- Shenzhen Science and Technology Program (GXWD20201231165807008, 20200830225317001, ZDSYS20210623091807023)
This publication has 26 references indexed in Scilit:
- OpenVINS: A Research Platform for Visual-Inertial Estimation2020
- Multi-Camera Visual-Inertial Navigation with Online Intrinsic and Extrinsic Calibration2019
- Visual-Inertial Navigation: A Concise Review2019
- Sensor-Failure-Resilient Multi-IMU Visual-Inertial Navigation2019
- DS-SLAM: A Semantic Visual SLAM towards Dynamic Environments2018
- Alternating-Stereo VINS: Observability Analysis and Performance Evaluation2018
- Mask-SLAM: Robust Feature-Based Monocular SLAM by Masking Using Semantic Segmentation2018
- A comparative analysis of tightly-coupled monocular, binocular, and stereo VINS2017
- A robust and modular multi-sensor fusion approach applied to MAV navigation2013
- IMU-RGBD camera 3D pose estimation and extrinsic calibration: Observability analysis and consistency improvement2013