Self-Consistent Graph Neural Networks for Semi-Supervised Node Classification
- 12 April 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Big Data
- Vol. 9 (4) , 1186-1197
Abstract
Graph Neural Networks (GNNs), the powerful graph representation technique based on deep learning, have attracted great research interest in recent years. Although many GNNs have achieved the state-of-the-art accuracy on a set of standard benchmark datasets, they are still limited to traditional semi-supervised framework and lack of sufficient supervision information, especially for the large amount of unlabeled data. To overcome this issue, we propose a novel self-consistent graph neural networks (SCGNN) framework to enrich the supervision information from two aspects: the self-consistency of unlabeled data and the label information of labeled data. First, in order to extract the self-supervision information from the numerous unlabeled nodes, we perform graph data augmentation and leverage a self-consistent constraint to maximize the mutual information of the unlabeled nodes across different augmented graph views. The self-consistency can sufficiently utilize the intrinsic structural attributes of the graph to extract the self-supervision information from unlabeled data and improve the subsequent classification result. Second, to further extract supervision information from scarce labeled nodes, we introduce a fusion mechanism to obtain comprehensive node embeddings by fusing node representations of two positive graph views, and optimize the classification loss over labeled nodes to maximize the utilization of label information. We conduct comprehensive empirical studies on six public benchmark datasets in node classification task. In terms of accuracy, SCGNN improves by an average of 2.08% over the best baseline, and specifically by 5.8% on the Disease dataset.Keywords
Funding Information
- National Natural Science Foundation of China (62172052, 61901297)
- University of Tianjin (TD13-5034)
- Special Foundation for Beijing Tianjin Hebei Basic Research Cooperation (21JCZXJC00170)
This publication has 26 references indexed in Scilit:
- Adaptive Propagation Graph Convolutional NetworkIEEE Transactions on Neural Networks and Learning Systems, 2020
- Multi-Label Graph Convolutional Network Representation LearningIEEE Transactions on Big Data, 2020
- A Comprehensive Survey on Graph Neural NetworksIEEE Transactions on Neural Networks and Learning Systems, 2020
- Deep Learning on Graphs: A SurveyIEEE Transactions on Knowledge and Data Engineering, 2020
- Cluster-GCN2019
- Data Representation and Learning With Graph Diffusion-Embedding Networks2019
- Co-Embedding Attributed Networks2019
- node2vec2016
- LINE2015
- DeepWalk2014