Research on 3D Point Cloud Object Detection Algorithm for Autonomous Driving
Open Access
- 17 February 2022
- journal article
- research article
- Published by Wiley in Mathematical Problems in Engineering
- Vol. 2022, 1-13
Abstract
In autonomous driving, lidar has become the main vehicle sensor due to its advantages such as long-range measurement and high accuracy. However, the collected point cloud data is sparse and unevenly distributed, and it lacks characterization capabilities when facing objects with missing or similar shapes, so that the detection accuracy is low while detecting long-distance small targets with similar shapes and a small number of point clouds. In order to improve the detection accuracy of small targets represented by point clouds, this paper adopts a method that fuses point cloud and RGB image to construct a 3D object detection network architecture based on two-stage complementary fusion. In the first stage of the fusion, we use the FPS method to select some points from the raw point cloud data as key points. Then, we voxelize the raw point cloud and use the 3D sparse convolutional neural network to extract multi-scale points cloud features, which would fuse features of different scales with key points. In the second stage of fusion, a 2D object detector is used to obtain the 2D bounding box and category information of the target in the image and take the camera as the origin to extend along the direction of the 2D bounding box to form a frustum; then the point cloud and target category information within the frustum are fused into the key points. This paper uses key points as a bridge to effectively combine the semantic information of the image such as texture and color with the point cloud features. The experimental results show that the network proposed in this paper has excellent performance on small objects.Keywords
Funding Information
- National Natural Science Foundation of China (61971007, 61571013)
This publication has 28 references indexed in Scilit:
- SECOND: Sparsely Embedded Convolutional DetectionSensors, 2018
- Deep Continuous Fusion for Multi-sensor 3D Object Detection2018
- VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection2018
- 3D Semantic Segmentation with Submanifold Sparse Convolutional Networks2018
- A General Pipeline for 3D Detection of Vehicles2018
- Multi-view 3D Object Detection Network for Autonomous Driving2017
- 3D Object Proposals Using Stereo Imagery for Accurate Object Class DetectionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Deep Sliding Shapes for Amodal 3D Object Detection in RGB-D Images2016
- Monocular 3D Object Detection for Autonomous Driving2016
- Are we ready for autonomous driving? The KITTI vision benchmark suite2012