A Simple Baseline for Multi-Camera 3D Object Detection
Open Access
- 26 June 2023
- journal article
- research article
- Published by Association for the Advancement of Artificial Intelligence (AAAI) in Proceedings of the AAAI Conference on Artificial Intelligence
- Vol. 37 (3) , 3507-3515
Abstract
3D object detection with surrounding cameras has been a promising direction for autonomous driving. In this paper, we present SimMOD, a Simple baseline for Multi-camera Object Detection, to solve the problem. To incorporate multiview information as well as build upon previous efforts on monocular 3D object detection, the framework is built on sample-wise object proposals and designed to work in a twostage manner. First, we extract multi-scale features and generate the perspective object proposals on each monocular image. Second, the multi-view proposals are aggregated and then iteratively refined with multi-view and multi-scale visual features in the DETR3D-style. The refined proposals are endto-end decoded into the detection results. To further boost the performance, we incorporate the auxiliary branches alongside the proposal generation to enhance the feature learning. Also, we design the methods of target filtering and teacher forcing to promote the consistency of two-stage training. We conduct extensive experiments on the 3D object detection benchmark of nuScenes to demonstrate the effectiveness of SimMOD and achieve competitive performance. Code will be available at https://github.com/zhangyp15/SimMOD.Keywords
All Related Versions
This publication has 22 references indexed in Scilit:
- PolarDETR: Polar Parametrization for vision-based surround-view 3D detectionImage and Vision Computing, 2025
- BEVFormer: Learning Bird’s-Eye-View Representation from Multi-camera Images via Spatiotemporal Transformers2022
- Learning Ego 3D Representation as Ray Tracing2022
- PETR: Position Embedding Transformation for Multi-view 3D Object Detection2022
- End-to-End Object Detection with Transformers2020
- 3D Bounding Box Estimation Using Deep Learning and Geometry2017
- Deep Residual Learning for Image Recognition2016
- Monocular 3D Object Detection for Autonomous Driving2016
- You Only Look Once: Unified, Real-Time Object Detection2016
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014