GFNet: Geometric Flow Network for 3D Point Cloud Semantic Segmentation
Preprint
Abstract
Point cloud semantic segmentation from projected views, such as range-view (RV) and bird's-eye-view (BEV), has been intensively investigated. Different views capture different information of point clouds and thus are complementary to each other. However, recent projection-based methods for point cloud semantic segmentation usually utilize a vanilla late fusion strategy for the predictions of different views, failing to explore the complementary information from a geometric perspective during the representation learning. In this paper, we introduce a geometric flow network (GFNet) to explore the geometric correspondence between different views in an align-before-fuse manner. Specifically, we devise a novel geometric flow module (GFM) to bidirectionally align and propagate the complementary information across different views according to geometric relationships under the end-to-end learning scheme. We perform extensive experiments on two widely used benchmark datasets, SemanticKITTI and nuScenes, to demonstrate the effectiveness of our GFNet for project-based point cloud semantic segmentation. Concretely, GFNet not only significantly boosts the performance of each individual view but also achieves state-of-the-art results over all existing projection-based models. Code is available at \url{https://github.com/haibo-qiu/GFNet}.Keywords
All Related Versions
This publication has 6 references indexed in Scilit:
- Deep Learning for LiDAR Point Clouds in Autonomous Driving: A ReviewIEEE Transactions on Neural Networks and Learning Systems, 2020
- A novel system for off-line 3D seam extraction and path planning based on point cloud segmentation for arc welding robotRobotics and Computer-Integrated Manufacturing, 2020
- 3D-MiniNet: Learning a 2D Representation From Point Clouds for Fast and Efficient 3D LIDAR Semantic SegmentationIEEE Robotics and Automation Letters, 2020
- Integrate Point-Cloud Segmentation with 3D LiDAR Scan-Matching for Mobile Robot Localization and MappingSensors, 2019
- Dynamic Graph CNN for Learning on Point CloudsACM Transactions on Graphics, 2019
- DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017