MOISST: Multimodal Optimization of Implicit Scene for SpatioTemporal Calibration
Authors:
- 1 October 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1810-1817
Abstract
With the recent advances in autonomous driving and the decreasing cost of LiDARs, the use of multimodal sensor systems is on the rise. However, in order to make use of the information provided by a variety of complimentary sensors, it is necessary to accurately calibrate them. We take advantage of recent advances in computer graphics and implicit volumetric scene representation to tackle the problem of multi-sensor spatial and temporal calibration. Thanks to a new formulation of the Neural Radiance Field (NeRF) optimization, we are able to jointly optimize calibration parameters along with scene representation based on radiometric and geometric measurements. Our method enables accurate and robust calibration from data captured in uncontrolled and unstructured urban environments, making our solution more scalable than existing calibration solutions. We demonstrate the accuracy and robustness of our method in urban scenes typically encountered in autonomous driving scenarios.Keywords
All Related Versions
This publication has 29 references indexed in Scilit:
- Motion-Based Calibration of Multimodal Sensor Extrinsics and Timing Offset EstimationIEEE Transactions on Robotics, 2016
- Structure-from-Motion Revisited2016
- ORB-SLAM: A Versatile and Accurate Monocular SLAM SystemIEEE Transactions on Robotics, 2015
- Spatio-temporal laser to visual/inertial calibration with applications to hand-held, large scale scanning2014
- Let There Be Color! Large-Scale Texturing of 3D Reconstructions2014
- A General Framework for Temporal Calibration of Multiple Proprioceptive and Exteroceptive Sensors2014
- Cross-calibration of push-broom 2D LIDARs and cameras in natural scenes2013
- Extrinsic calibration of a camera and laser range finder (improves camera calibration)2005
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Animating rotation with quaternion curves1985