Location-Guided LiDAR-Based Panoptic Segmentation for Autonomous Driving
- 1 August 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Vehicles
- Vol. 8 (2) , 1473-1483
Abstract
The application of artificial intelligence in autonomous driving is becoming increasingly extensive. LiDAR-based 3D point cloud panoptic segmentation is one of the most promising and arduous tasks. Although recent methods have produced promising results, most of them ignore the prior distribution of objects in the 3D point clouds. In this paper, we first investigate the distribution of objects around the heading of vehicles and observe that several objects are severely biased. On the basis of this observation, we use the bird's eye view (BEV) representation to project the 3D point clouds into a 2D image and divide the BEV projection into eight areas. For each area, we apply input-dependent convolution kernels to extract the local feature. These local features are concatenated to the panoptic backbone for panoptic segmentation. We validate our method on the validation and test sets of the SemanticKITTI dataset. The proposed method outperforms all state-of-the-art methods based on 2D projection in terms of higher panoptic quality scores.Keywords
Funding Information
- Shanghai Municipal Science and Technology Major Project (2018SHZDZX01)
- ZJ Lab
- Shanghai Center for Brain Science and Brain-Inspired Technology
This publication has 54 references indexed in Scilit:
- PointPillars: Fast Encoders for Object Detection From Point Clouds2019
- Seamless Scene Segmentation2019
- Semantic Labeling and Instance Segmentation of 3D Point Clouds Using Patch Context Analysis and Multiscale ProcessingIEEE Transactions on Visualization and Computer Graphics, 2018
- The Lovasz-Softmax Loss: A Tractable Surrogate for the Optimization of the Intersection-Over-Union Measure in Neural Networks2018
- SGPN: Similarity Group Proposal Network for 3D Point Cloud Instance Segmentation2018
- SqueezeSeg: Convolutional Neural Nets with Recurrent CRF for Real-Time Road-Object Segmentation from 3D LiDAR Point Cloud2018
- Mask R-CNN2017
- PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation2017
- Fast segmentation of 3D point clouds: A paradigm on LiDAR data for autonomous vehicle applications2017
- Vision2010