EnGN: A High-Throughput and Energy-Efficient Accelerator for Large Graph Neural Networks
Author:
Preprint
Abstract
Inspired by the great success of convolutional neural networks on structural data like videos and images, graph neural network (GNN) emerges as a powerful approach to process non-euclidean data structures and has been proved powerful in various application domains such as social network, e-commerce, and knowledge graph. However, such graph data maintained in IT companies can be extremely large and sparse, thus employing GNNs to deal with them requires substantial computational power and memory bandwidth, which induces the considerable energy and resources cost spent on general-purpose CPUs and GPUs. In addition, GNN operating on irregular graphs can hardly be fitted to the conventional neural network accelerators or graph processors, which are not designed to support the computation abstraction of GNNs. This work presents a specialized accelerator architecture, EnGN, to enable high-throughput and energy-efficient processing of large-scale graph neural networks. The proposed EnGN is designed to accelerate the three key stages of GNN propagation, which is abstracted as common computing patterns shared by typical GNNs. To support the key stages simultaneously, we propose the ring-edge-reduce(RER) dataflow that tames the poor locality of sparsely-and-randomly connected vertices, and the RER PE-array to practice RER dataflow. In addition, we utilize a graph tiling strategy to fit large graphs into EnGN and make the best use of the hierarchical on-chip buffers through adaptive computation reordering and tile scheduling. The experiments on representative GNN models with the input of realistic graphs shows that EnGN achieves 303.45x and 4.44x performance speedup while consuming 1370.52x and 93.73x less energy on average when compared to the CPU and GPU baselines empowered by the state-of-the-art software frameworks, respectively.Keywords
All Related Versions
This publication has 8 references indexed in Scilit:
- A Comprehensive Survey on Graph Neural NetworksIEEE Transactions on Neural Networks and Learning Systems, 2020
- Graph neural networks: A review of methods and applicationsAI Open, 2020
- Cross-lingual Knowledge Graph Alignment via Graph Matching Neural Network2019
- OmniGraph: A Scalable Hardware Accelerator for Graph Processing2017
- Knowledge Transfer for Out-of-Knowledge-Base Entities : A Graph Neural Network Approach2017
- Energy efficient architecture for graph analytics acceleratorsACM SIGARCH Computer Architecture News, 2016
- Medusa: Simplified Graph Processing on GPUsIEEE Transactions on Parallel and Distributed Systems, 2013
- DRAMSim2: A Cycle Accurate Memory System SimulatorIEEE Computer Architecture Letters, 2011