Deep Learning Based 3D Segmentation: A Survey
Preprint
Abstract
3D segmentation is a fundamental and challenging problem in computer vision with applications in autonomous driving, robotics, augmented reality and medical image analysis. It has received significant attention from the computer vision, graphics and machine learning communities. Conventional methods for 3D segmentation, based on hand-crafted features and machine learning classifiers, lack generalization ability. Driven by their success in 2D computer vision, deep learning techniques have recently become the tool of choice for 3D segmentation tasks. This has led to an influx of a large number of methods in the literature that have been evaluated on different benchmark datasets. Whereas survey papers on RGB-D and point cloud segmentation exist, there is a lack of an in-depth and recent survey that covers all 3D data modalities and application domains. This paper fills the gap and provides a comprehensive survey of the recent progress made in deep learning based 3D segmentation. It covers over 180 works, analyzes their strengths and limitations and discusses their competitive results on benchmark datasets. The survey provides a summary of the most commonly used pipelines and finally highlights promising research directions for the future.Keywords
All Related Versions
This publication has 41 references indexed in Scilit:
- Transformer fusion for indoor RGB-D semantic segmentationComputer Vision and Image Understanding, 2024
- PCSCNet: Fast 3D semantic segmentation of LiDAR point cloud for autonomous car using point convolution and sparse convolution networkExpert Systems with Applications, 2022
- DRGCNN: Dynamic region graph convolutional neural network for point cloudsExpert Systems with Applications, 2022
- A review of deep learning methods for semantic segmentation of remote sensing imageryExpert Systems with Applications, 2021
- SqueezeSegV3: Spatially-Adaptive Convolution for Efficient Point-Cloud Segmentation2020
- A survey on indoor RGB-D semantic segmentation: from hand-crafted features to deep convolutional neural networksMultimedia Tools and Applications, 2019
- Multimodal sensor-based semantic 3D mapping for a large-scale environmentExpert Systems with Applications, 2018
- RGB-D joint modelling with scene geometric information for indoor semantic segmentationMultimedia Tools and Applications, 2018
- SnapNet: 3D point cloud semantic labeling with 2D deep segmentation networksComputers & Graphics, 2018
- 3D shape segmentation via shape fully convolutional networksComputers & Graphics, 2018