GATe: Streamlining Memory Access and Communication to Accelerate Graph Attention Network With Near-Memory Processing
- 10 April 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Computer Architecture Letters
- Vol. 23 (1) , 87-90
Abstract
Graph Attention Network (GAT) has gained widespread adoption thanks to its exceptional performance. The critical components of a GAT model involve aggregation and attention, which cause numerous main-memory access. Recently, much research has proposed near-memory processing (NMP) architectures to accelerate aggregation. However, graph attention requires additional operations distinct from aggregation, making previous NMP architectures less suitable for supporting GAT. In this paper, we propose GATe, a practical and efficient GAT acc e lerator with NMP architecture. To the best of our knowledge, this is the first time that accelerates both attention and aggregation computation on DIMM. In the attention and aggregation phases, we unify feature vector access to reduce repetitive memory accesses and refine the computation flow to reduce communication. Furthermore, we introduce a novel sharding method that enhances the data reusability. Experiments show that our work achieves substantial speedup of up to 6.77× and 2.46×, respectively, compared to state-of-the-art NMP works GNNear and GraNDe.Keywords
This publication has 9 references indexed in Scilit:
- Architectural Implications of GNN Aggregation Programming AbstractionsIEEE Computer Architecture Letters, 2023
- A Flexible Embedding-Aware Near Memory Processing Architecture for Recommendation SystemIEEE Computer Architecture Letters, 2023
- GraNDe: Efficient Near-Data Processing Architecture for Graph Neural NetworksIEEE Transactions on Computers, 2023
- GNNear2022
- G-NMP: Accelerating Graph Neural Networks with DIMM-based Near-Memory ProcessingJournal of Systems Architecture, 2022
- An Area-Efficient and High Throughput Hardware Implementation of Exponent Function2022
- RecNMP: Accelerating Personalized Recommendation with Near-Memory Processing2020
- DRAMsim3: A Cycle-Accurate, Thermal-Capable DRAM SimulatorIEEE Computer Architecture Letters, 2020
- RooflineCommunications of the ACM, 2009