Coco-LIC: Continuous-Time Tightly-Coupled LiDAR-Inertial-Camera Odometry Using Non-Uniform B-Spline
- 14 September 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 8 (11) , 7074-7081
Abstract
In this paper, we propose an effcient continuous-time LiDAR-Inertial-Camera Odometry, utilizing non-uniform B-splines to tightly couple measurements from the LiDAR, IMU, and camera. In contrast to uniform B-spline-based continuous-time methods, our non-uniform B-spline approach offers signifcant advantages in terms of achieving real-time effciency and high accuracy. This is accomplished by dynamically and adaptively placing control points, taking into account the varying dynamics of the motion. To enable effcient fusion of heterogeneous LiDAR-Inertial-Camera data within a short sliding-window optimization, we assign depth to visual pixels using corresponding map points from a global LiDAR map, and formulate frame-to-map reprojection factors for the associated pixels in the current image frame. This way circumvents the necessity for depth optimization of visual pixels, which typically entails a lengthy sliding window with numerous control points for continuous-time trajectory estimation. We conduct dedicated experiments on real-world datasets to demonstrate the advantage and effcacy of adopting non-uniform continuous-time trajectory representation. Our LiDAR-Inertial-Camera odometry system is also extensively evaluated on both challenging scenarios with sensor degenerations and large-scale scenarios, and has shown comparable or higher accuracy than the state-of-the-art methods. The codebase of this paper will also be open-sourced at https://github.com/APRIL-ZJU/Coco-LIC .Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (61836015)
This publication has 36 references indexed in Scilit:
- OpenVINS: A Research Platform for Visual-Inertial Estimation2020
- LIC-Fusion: LiDAR-Inertial-Camera Odometry2019
- Stereo Visual Inertial LiDAR Simultaneous Localization and Mapping2019
- Laser–visual–inertial odometry and mapping with high robustness and low driftJournal of Field Robotics, 2018
- Continuous-Time Visual-Inertial Odometry for Event CamerasIEEE Transactions on Robotics, 2018
- VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State EstimatorIEEE Transactions on Robotics, 2018
- Pose Interpolation for Rolling Shutter Cameras using Non Uniformly Time-Sampled B-splines2017
- A General Approach to Spatiotemporal Calibration in Multisensor SystemsIEEE Transactions on Robotics, 2016
- Continuous-time batch trajectory estimation using temporal basis functionsThe International Journal of Robotics Research, 2015
- Rolling Shutter Camera Calibration2013