A survey of field programmable gate array (FPGA)-based graph convolutional neural network accelerators: challenges and opportunities
Authors:
Open Access
- 28 November 2022
- journal article
- research article
- Published by PeerJ in PeerJ Computer Science
- Vol. 8, e1166
Abstract
Graph convolutional networks (GCNs) based on convolutional operations have been developed recently to extract high-level representations from graph data. They have shown advantages in many critical applications, such as recommendation system, natural language processing, and prediction of chemical reactivity. The problem for the GCN is that its target applications generally pose stringent constraints on latency and energy efficiency. Several studies have demonstrated that field programmable gate array (FPGA)-based GCNs accelerators, which balance high performance and low power consumption, can continue to achieve orders-of-magnitude improvements in the inference of GCNs models. However, there still are many challenges in customizing FPGA-based accelerators for GCNs. It is necessary to sort out the current solutions to these challenges for further research. For this purpose, we first summarize the four challenges in FPGA-based GCNs accelerators. Then we introduce the process of the typical GNN algorithm and several examples of representative GCNs. Next, we review the FPGA-based GCNs accelerators in recent years and introduce their design details according to different challenges. Moreover, we compare the key metrics of these accelerators, including resource utilization, performance, and power consumption. Finally, we anticipate the future challenges and directions for FPGA-based GCNs accelerators: algorithm and hardware co-design, efficient task scheduling, higher generality, and faster development.Keywords
This publication has 56 references indexed in Scilit:
- Message-Passing Neural Networks Learn Little’s LawIEEE Communications Letters, 2018
- A survey of FPGA-based accelerators for convolutional neural networksNeural Computing and Applications, 2018
- A CNN Accelerator on FPGA Using Depthwise Separable ConvolutionIEEE Transactions on Circuits and Systems II: Express Briefs, 2018
- Geometric Deep Learning: Going beyond Euclidean dataIEEE Signal Processing Magazine, 2017
- EyerissACM SIGARCH Computer Architecture News, 2016
- 3D FFTs on a Single FPGA2014
- The Graph Neural Network ModelIEEE Transactions on Neural Networks, 2008
- NVIDIA Tesla: A Unified Graphics and Computing ArchitectureIEEE Micro, 2008
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- Supervised neural networks for the classification of structuresIEEE Transactions on Neural Networks, 1997