Ctrl-VIO: Continuous-Time Visual-Inertial Odometry for Rolling Shutter Cameras
- 29 August 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 7 (4) , 11537-11544
Abstract
In this letter, we propose a probabilistic continuous-time visual-inertial odometry (VIO) for rolling shutter cameras. The continuous-time trajectory formulation naturally facilitates the fusion of asynchronized high-frequency IMU data and motion-distorted rolling shutter images. To prevent intractable computation load, the proposed VIO is sliding-window and keyframe-based. We propose to probabilistically marginalize the control points to keep the constant number of keyframes in the sliding window. Furthermore, the line exposure time difference (line delay) of the rolling shutter camera can be online calibrated in our continuous-time VIO. To extensively examine the performance of our continuous-time VIO, experiments are conducted on publicly-available WHU-RSVI, TUM-RSVI, and SenseTime-RSVI rolling shutter datasets. The results demonstrate the proposed continuous-time VIO significantly outperforms the existing state-of-the-art VIO methods.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (6208810)
This publication has 33 references indexed in Scilit:
- Initialization-Free Monocular Visual-Inertial State Estimation with Application to Autonomous MAVs2015
- A Spline-Based Trajectory Representation for Sensor Fusion and Rolling Shutter CamerasInternational Journal of Computer Vision, 2015
- Keyframe-based visual–inertial odometry using nonlinear optimizationThe International Journal of Robotics Research, 2014
- High-fidelity sensor modeling and self-calibration in vision-aided inertial navigation2014
- Rolling Shutter Camera Calibration2013
- Spline Fusion: A continuous-time representation for visual-inertial fusion with application to rolling shutter cameras2013
- Rolling shutter bundle adjustment2012
- Sliding window filter with application to planetary landingJournal of Field Robotics, 2010
- Parallel Tracking and Mapping for Small AR Workspaces2007
- A Multi-State Constraint Kalman Filter for Vision-aided Inertial NavigationProceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (cat. No.01ch37164), 2007