A Continuous-Time Approach for 3D Radar-to-Camera Extrinsic Calibration
Authors:
- 30 May 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 13164-13170
Abstract
Reliable operation in inclement weather is essential to the deployment of safe autonomous vehicles (AVs). Robustness and reliability can be achieved by fusing data from the standard AV sensor suite (i.e., lidars, cameras) with weather robust sensors, such as millimetre-wavelength radar. Critically, accurate sensor data fusion requires knowledge of the rigidbody transform between sensor pairs, which can be determined through the process of extrinsic calibration. A number of extrinsic calibration algorithms have been designed for 2D (planar) radar sensors—however, recently-developed, low-cost 3D millimetre-wavelength radars are set to displace their 2D counterparts in many applications. In this paper, we present a continuous-time 3D radar-to-camera extrinsic calibration algorithm that utilizes radar velocity measurements and, unlike the majority of existing techniques, does not require specialized radar retroreflectors to be present in the environment. We derive the observability properties of our formulation and demonstrate the efficacy of our algorithm through synthetic and real-world experiments.Keywords
All Related Versions
This publication has 23 references indexed in Scilit:
- Comparative analysis of RADAR-IR sensor fusion methods for object detection2017
- State Estimation for Robotics2017
- Continuous-time batch trajectory estimation using temporal basis functionsThe International Journal of Robotics Research, 2015
- Radar and vision sensors calibration for outdoor 3D reconstruction2015
- Data fusion of radar and image measurements for multi-object tracking via Kalman filteringInformation Sciences, 2014
- Online temporal calibration for camera–IMU systems: Theory and algorithmsThe International Journal of Robotics Research, 2014
- Integrating Millimeter Wave Radar with a Monocular Vision Sensor for On-Road Obstacle Detection ApplicationsSensors, 2011
- Principles of Modern Radar: Basic principles2010
- Structure from motion causally integrated over timeIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- Nonlinear controllability and observabilityIEEE Transactions on Automatic Control, 1977