MAFF-Net: Filter False Positive for 3D Vehicle Detection with Multi-modal Adaptive Feature Fusion
Authors:
- 8 October 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 369-376
Abstract
3D vehicle detection based on multi-modal fusion is an important task of many applications such as autonomous driving. Although significant progress has been made, we still observe two aspects that calls for further improvement: First, what extra information can be obtained from the images to complement the point clouds in 3D detection tasks is seldom explored by previous works. Second, most fusion modules can only be used in their designed network, lacking universality. In this work, we propose PointAttentionFusion and DenseAttentionFusion: two end-to-end trainable single-stage multi-modal feature fusion approaches to adaptively combine RGB and point cloud modalities. Experimental results on the KITTI dataset demonstrate significant improvement in filtering false positive over the approaches using only point cloud data. Furthermore, the proposed methods can provide competitive results compared to the published state-of-the-art multi-modal methods in the KITTI benchmark. Both fusion modules are applicable in all voxel-based 3D detection architectures and similar improvements are expected.Keywords
All Related Versions
This publication has 38 references indexed in Scilit:
- SECOND: Sparsely Embedded Convolutional DetectionSensors, 2018
- Deep Continuous Fusion for Multi-sensor 3D Object Detection2018
- RT3D: Real-Time 3-D Vehicle Detection in LiDAR Point Cloud for Autonomous DrivingIEEE Robotics and Automation Letters, 2018
- PIXOR: Real-time 3D Object Detection from Point Clouds2018
- VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection2018
- 3D fully convolutional network for vehicle detection in point cloud2017
- Multi-view 3D Object Detection Network for Autonomous Driving2017
- Vote3Deep: Fast object detection in 3D point clouds using efficient convolutional neural networks2017
- Voting for Voting in Online Point Cloud Object Detection2015
- Are we ready for autonomous driving? The KITTI vision benchmark suite2012