Attention-Augmented Parametric Kernel Graph Neural Network (APKGNN) for Node Classification
Authors:
Open Access
- 15 December 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 744-751
Abstract
We present a new graph neural network, the Attention-based Parametric-Kernel augmented Graph Neural Network (APKGNN), developed for node classification tasks. Despite extensive work on modeling multi-faceted relationships between connected nodes of a graph, the effect of attention on edge features mapped to relationships has not yet been analyzed through learning representation. This study derives such an attention vector by first calculating node features corresponding to endpoints of an edge and then aggregating these with extracted local intrinsic patches of a given graph to generate augmented local patch vectors. This process uses a parametric kernel based on Gaussian mixture models (GMMs) to embed local neighborhoods of the graph in local patches. The patch vectors then convolve with the above node features to produce an updated node representation. We show that this new learning representation (APKGNN) achieves higher node classification accuracy on tasks - both standard benchmarks (Cora, PubMed, Citeseer) and new experimental short text corpora where nodes correspond to text documents and words. This implementation of the GNN convolution layer outperforms state-of-the-art (SOTA) algorithms, achieving higher training, validation, and test accuracy by a significant margin on three standard benchmark data sets under both SOTA experimental settings and those for new testbeds.Keywords
This publication has 14 references indexed in Scilit:
- HPCGCN: A Predictive Framework on High Performance Computing Cluster Log Data Using Graph Convolutional Networks2021
- Tracing Relevant Twitter Accounts Active in Cyber Threat Intelligence Domain by Exploiting Content and Structure of Twitter Network2021
- Corpus and Deep Learning Classifier for Collection of Cyber Threat Indicators in Twitter Stream2018
- SplineCNN: Fast Geometric Deep Learning with Continuous B-Spline Kernels2018
- Geometric Deep Learning on Graphs and Manifolds Using Mixture Model CNNs2017
- You Only Look Once: Unified, Real-Time Object Detection2016
- Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research GroupsIEEE Signal Processing Magazine, 2012
- A new model for learning in graph domains2006
- A general framework for adaptive processing of data structuresIEEE Transactions on Neural Networks, 1998
- Supervised neural networks for the classification of structuresIEEE Transactions on Neural Networks, 1997