Exploiting Intrinsic Redundancies in Dynamic Graph Neural Networks for Processing Efficiency
- 7 December 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Computer Architecture Letters
- Vol. 23 (2) , 170-174
Abstract
Modern dynamical systems are rapidly incorporating artificial intelligence to improve the efficiency and quality of complex predictive analytics. To efficiently operate on increasingly large datasets and intrinsically dynamic non-euclidean data structures, the computing community has turned to Graph Neural Networks (GNNs). We make a key observation that existing GNN processing frameworks do not efficiently handle the intrinsic dynamics in modern GNNs. The dynamic processing of GNN operates on the complete static graph at each time step, leading to repetitive redundant computations that introduce tremendous under-utilization of system resources. We propose a novel dynamic graph neural network (DGNN) processing framework that captures the dynamically evolving dataflow of the GNN semantics, i.e., graph embeddings and sparse connections between graph nodes. The framework identifies intrinsic redundancies in node-connections and captures representative node-sparse graph information that is readily ingested for processing by the system. Our evaluation on an NVIDIA GPU shows up to 3.5× speedup over the baseline setup that processes all nodes at each time step.Keywords
Funding Information
- Semiconductor Research Corporation
- U.S. Government
- Naval Research Laboratory
This publication has 9 references indexed in Scilit:
- MergePath-SpMM: Parallel Sparse Matrix-Matrix Algorithm for Graph Neural Network Acceleration2023
- FlowGNN: A Dataflow Architecture for Real-Time Workload-Agnostic Graph Neural Network Inference2023
- Efficient scaling of dynamic graph neural networks2021
- Computing Graph Neural Networks: A Survey from Algorithms to AcceleratorsACM Computing Surveys, 2021
- EvolveGCN: Evolving Graph Convolutional Networks for Dynamic GraphsProceedings of the AAAI Conference on Artificial Intelligence, 2020
- Dynamic graph convolutional networksPattern Recognition, 2020
- Structured Sequence Modeling with Graph Convolutional Recurrent Networks2018
- Graph Signal Processing: Overview, Challenges, and ApplicationsProceedings of the IEEE, 2018
- Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine TranslationarXiv, 2014