Multi-Modal 3D Object Detection in Autonomous Driving: a Survey
Preprint
Abstract
In this survey, we first introduce the background of popular sensors used for self-driving, their data properties, and the corresponding object detection algorithms. Next, we discuss existing datasets that can be used for evaluating multi-modal 3D object detection algorithms. Then we present a review of multi-modal fusion based 3D detection networks, taking a close look at their fusion stage, fusion input and fusion granularity, and how these design choices evolve with time and technology. After the review, we discuss open challenges as well as possible solutions. We hope that this survey can help researchers to get familiar with the field and embark on investigations in the area of multi-modal 3D object detection.Keywords
All Related Versions
This publication has 45 references indexed in Scilit:
- PETR: Position Embedding Transformation for Multi-view 3D Object Detection2022
- LIDAR–camera fusion for road detection using fully convolutional neural networksRobotics and Autonomous Systems, 2019
- Multimodal vehicle detection: fusing 3D-LIDAR and color camera dataPattern Recognition Letters, 2018
- Deep visual domain adaptation: A surveyNeurocomputing, 2018
- Mastering the game of Go with deep neural networks and tree searchNature, 2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009
- Autonomous driving in urban environments: Boss and the Urban ChallengeJournal of Field Robotics, 2008
- A Multi-view Camera Tracking for Modeling of Indoor Environment2004
- A common framework for image segmentationInternational Journal of Computer Vision, 1991