Loosely Coupled Stereo VINS Based on Point-Line Features Tracking With Feedback Loops
- 28 February 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 73 (8) , 10916-10931
Abstract
Visual-inertial navigation system (VINS) is a state-of-the-art technology for estimating the motion and position of moving objects, such as drones and robots. Tightly coupled methods have high accuracy but low real-time performance, while loosely coupled systems are more efficient, especially for resource-constrained systems. This study proposes a real-time loosely coupled stereo VINS based on point-line features. Unlike filter-based or optimization-based approaches, the pose estimation process is modeled as a control system. Firstly, as a loosely coupled scheme, the inertial measurement unit (IMU) data is used as the core of the proposed system. Feedback loops are introduced to correct the IMU bias, including a visual-inertial inter-frame bias estimation feedback loop and a versatile quaternion-based filter (VQF) gyroscope bias estimation feedback loop. Secondly, the accelerometer inclination correction based on VQF is introduced in the IMU propagation stage to account for slow inclination drift. To achieve better visual-inertial calibration bias results, line features are introduced in the visual part to improve accuracy and robustness. The scale of the line features is controlled by judging distance and gradient thresholds to improve the real-time performance of the edge drawing lines (EDLines) algorithm. The proposed method is evaluated on the EuRoC MAV dataset and tested on the KITTI dataset. The comparisons with previous methods on benchmark datasets demonstrate the effectiveness of the proposed method in terms of localization accuracy and real-time performance.Keywords
Funding Information
- National Natural Science Foundation of China (62133011)
- National Key Research and Development Program of China (2020AAA0108100)
- Shanghai International Science and Technology Cooperation Project (22510712000)
This publication has 42 references indexed in Scilit:
- VQF: Highly accurate IMU orientation estimation with bias estimation and magnetic disturbance rejectionInformation Fusion, 2022
- Dynamic SLAM Algorithm Fusing Semantic Information and Geometric Constraints2022
- PLD-VINS: RGBD visual-inertial SLAM with point and line featuresAerospace Science and Technology, 2021
- PIRVS: An Advanced Visual-Inertial SLAM System with Flexible Sensor Fusion and Hardware Co-Design2018
- An efficient and robust line segment matching approach based on LBD descriptor and pairwise geometric consistencyJournal of Visual Communication and Image Representation, 2013
- Are we ready for autonomous driving? The KITTI vision benchmark suite2012
- ORB: An efficient alternative to SIFT or SURF2011
- EDLines: A real-time line segment detector with a false detection controlPattern Recognition Letters, 2011
- Estimation of IMU and MARG orientation using a gradient descent algorithm2011
- Good features to track1994