Accurate and Consistent Spatiotemporal Calibration for Heterogenous-Camera/ IMU/LiDAR System Based on Continuous-Time Batch Estimation
- 20 October 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ASME Transactions on Mechatronics
- Vol. 29 (3) , 2009-2020
Abstract
Nowadays, multisensor fusion, which could compensate for the deficiencies of stand-alone sensors, has been widely accepted as a feasible solution for navigation and perception tasks. To achieve optimal information fusion, accurate intersensor spatiotemporal transformation is a fundamental prerequisite. However, few existing calibration methods could accurately and flexibly calibrate spatiotemporal parameters for camera/inertial measurement unit (IMU)/light detection and ranging (LiDAR) sensor suites without relying on artificial targets and manual intervention, especially for those low-cost suites that employ rolling shutter (RS) cameras. To this end, building upon our previous work (i.e., two-step LiDAR-IMU-camera (LIC)-calib), we propose a spatiotemporal calibration method for heterogenous-camera/IMU/LiDAR systems, which supports both global shutter (GS) and RS cameras, and enables intrinsic refinement. In particular, a novel initialization method is developed to provide accurate initial guesses, requiring no prior knowledge or calibration infrastructure. To further improve the calibration consistency and accuracy, the split calibration of camera/IMU and LiDAR/IMU in two-step is unified into a global nonlinear optimization problem. Both simulated and real-world experiments were conducted for quantitative evaluation, and the results demonstrate that the proposed method outperforms its predecessor and other state-of-the-art methods.Keywords
Funding Information
- National Key Research and Development Program of China (2021YFB2501102)
- National Natural Science Foundation of China (41974027)
- Sino-German Mobility Programme (M-0054)
This publication has 36 references indexed in Scilit:
- Globally Optimal Symbolic Hand-Eye CalibrationIEEE/ASME Transactions on Mechatronics, 2020
- 3D Optical Machine Vision Sensors With Intelligent Data Management for Robotic Swarm Navigation ImprovementIEEE Sensors Journal, 2020
- LIC-Fusion: LiDAR-Inertial-Camera Odometry2019
- Error modeling and extrinsic–intrinsic calibration for LiDAR-IMU system based on cone-cylinder featuresRobotics and Autonomous Systems, 2019
- Survey of Higher Order Rigid Body Motion Interpolation Methods for Keyframe Animation and Continuous-Time Trajectory Estimation2018
- Continuous-Time Visual-Inertial Odometry for Event CamerasIEEE Transactions on Robotics, 2018
- VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State EstimatorIEEE Transactions on Robotics, 2018
- OpenMVG: Open Multiple View Geometry2017
- Non-Parametric Extrinsic and Intrinsic Calibration of Visual-Inertial Sensor SystemsIEEE Sensors Journal, 2016
- A Kalman Filter-Based Algorithm for IMU-Camera Calibration: Observability Analysis and Performance EvaluationIEEE Transactions on Robotics, 2008