An Efficient FPGA Accelerator for Point Cloud
Authors:
- 5 September 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Abstract
Deep learning-based point cloud processing plays an important role in various vision tasks, such as autonomous driving, virtual reality (VR), and augmented reality (AR). The submanifold sparse convolutional network (SSCN) has been widely used for the point cloud due to its unique advantages in terms of visual results. However, existing convolutional neural network accelerators suffer from non-trivial performance degradation when employed to accelerate SSCN because of the extreme and unstructured sparsity, and the complex computational dependency between the sparsity of the central activation and the neighborhood ones. In this paper, we propose a high performance FPGA-based accelerator for SSCN. Firstly, we develop a zero removing strategy to remove the coarse-grained redundant regions, thus significantly improving computational efficiency. Secondly, we propose a concise encoding scheme to obtain the matching information for efficient point-wise multiplications. Thirdly, we develop a sparse data matching unit and a computing core based on the proposed encoding scheme, which can convert the irregular sparse operations into regular multiply-accumulate operations. Finally, an efficient hardware architecture for the submanifold sparse convolutional layer is developed and implemented on the Xilinx ZCU102 field-programmable gate array board, where the 3D submanifold sparse U-Net is taken as the benchmark. The experimental results demonstrate that our design drastically improves computational efficiency, and can dramatically improve the power efficiency by 51 times compared to GPU.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China
This publication has 16 references indexed in Scilit:
- KPConv: Flexible and Deformable Convolution for Point Clouds2019
- An FPGA based Parallel Implementation for Point Cloud Neural Network2019
- Accelerating DNN-based 3D point cloud processing for mobile computingScience China Information Sciences, 2019
- PointRCNN: 3D Object Proposal Generation and Detection From Point Cloud2019
- 3D Semantic Segmentation with Submanifold Sparse Convolutional Networks2018
- SEGCloud: Semantic Segmentation of 3D Point Clouds2017
- Sparsity Invariant CNNs2017
- Deep Projective 3D Semantic Segmentation2017
- Point cloud labeling using 3D Convolutional Neural Network2016
- EyerissACM SIGARCH Computer Architecture News, 2016