Rethinking 3-D LiDAR Point Cloud Segmentation
- 16 December 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 36 (3) , 4079-4090
Abstract
Many point-based semantic segmentation methods have been designed for indoor scenarios, but they struggle if they are applied to point clouds that are captured by a light detection and ranging (LiDAR) sensor in an outdoor environment. In order to make these methods more efficient and robust such that they can handle LiDAR data, we introduce the general concept of reformulating 3-D point-based operations such that they can operate in the projection space. While we show by means of three point-based methods that the reformulated versions are between 300 and 400 times faster and achieve higher accuracy, we furthermore demonstrate that the concept of reformulating 3-D point-based operations allows to design new architectures that unify the benefits of point-based and image-based methods. As an example, we introduce a network that integrates reformulated 3-D point-based operations into a 2-D encoder-decoder architecture that fuses the information from different 2-D scales. We evaluate the approach on four challenging datasets for semantic LiDAR point cloud segmentation and show that leveraging reformulated 3-D point-based operations with 2-D image-based operations achieves very good results for all four datasets.Keywords
All Related Versions
Funding Information
- Deutsche Forschungsgemeinschaft (DFG), German Research Foundation, through Germany’s Excellence Strategy (EXC 2070-390732324, GA1927/5-2)
- FOR 2535 Anticipating Human Behavior
This publication has 38 references indexed in Scilit:
- SpiderCNN: Deep Learning on Point Sets with Parameterized Convolutional Filters2018
- 3DMV: Joint 3D-Multi-view Prediction for 3D Semantic Scene Segmentation2018
- DenseASPP for Semantic Segmentation in Street Scenes2018
- The Lovasz-Softmax Loss: A Tractable Surrogate for the Optimization of the Intersection-Over-Union Measure in Neural Networks2018
- SPLATNet: Sparse Lattice Networks for Point Cloud Processing2018
- Tangent Convolutions for Dense Prediction in 3D2018
- Pyramid Scene Parsing Network2017
- Analysis of farthest point sampling for approximating geodesics in a graphComputational Geometry, 2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- The Pascal Visual Object Classes Challenge: A RetrospectiveInternational Journal of Computer Vision, 2014