Collaborative Graph Neural Networks for Attributed Network Embedding
Preprint
Abstract
Graph neural networks (GNNs) have shown prominent performance on attributed network embedding. However, existing efforts mainly focus on exploiting network structures, while the exploitation of node attributes is rather limited as they only serve as node features at the initial layer. This simple strategy impedes the potential of node attributes in augmenting node connections, leading to limited receptive field for inactive nodes with few or even no neighbors. Furthermore, the training objectives (i.e., reconstructing network structures) of most GNNs also do not include node attributes, although studies have shown that reconstructing node attributes is beneficial. Thus, it is encouraging to deeply involve node attributes in the key components of GNNs, including graph convolution operations and training objectives. However, this is a nontrivial task since an appropriate way of integration is required to maintain the merits of GNNs. To bridge the gap, in this paper, we propose COllaborative graph Neural Networks--CONN, a tailored GNN architecture for attribute network embedding. It improves model capacity by 1) selectively diffusing messages from neighboring nodes and involved attribute categories, and 2) jointly reconstructing node-to-node and node-to-attribute-category interactions via cross-correlation. Experiments on real-world networks demonstrate that CONN excels state-of-the-art embedding algorithms with a great margin.Keywords
All Related Versions
This publication has 34 references indexed in Scilit:
- Double Wins: Boosting Accuracy and Efficiency of Graph Neural Networks by Reliable Knowledge Distillation2023
- Understanding the message passing in graph neural networks via power iteration clusteringNeural Networks, 2021
- Multi-Scale attributed node embeddingJournal of Complex Networks, 2021
- g-Inspector: Recurrent Attention Model on GraphIEEE Transactions on Knowledge and Data Engineering, 2020
- Community-oriented attributed network embeddingKnowledge-Based Systems, 2020
- Graph neural networks: A review of methods and applicationsAI Open, 2020
- Learning Graph Representation With Generative Adversarial NetsIEEE Transactions on Knowledge and Data Engineering, 2019
- Deep Inductive Graph Representation LearningIEEE Transactions on Knowledge and Data Engineering, 2018
- A Unified Framework for Community Detection and Network Representation LearningIEEE Transactions on Knowledge and Data Engineering, 2018
- Attributed Social Network EmbeddingIEEE Transactions on Knowledge and Data Engineering, 2018