Graph Representation Learning With Adaptive Metric
- 25 January 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Network Science and Engineering
- Vol. 10 (4) , 2074-2085
Abstract
Contrastive learning has been widely used in graph representation learning, which extracts node or graph representations by contrasting positive and negative node pairs. It requires node representations (embeddings) to reflect their correlations in topology, increasing the similarities between an anchor node and its positive nodes, or reducing the similarities with its negative nodes in embedding space. However, most existing contrastive models measure similarities through a fixed metric that equally scores all sample pairs in a specific feature space, but ignores the varieties of node attributes and network topologies. Moreover, these fixed metrics are always defined explicitly and manually, which makes them unsuitable for applying to all graphs and networks. To solve these problems, we propose a novel graph representation learning model with an adaptive metric, called GRAM, which produces appropriate similarity scores of node pairs according to the different significance of each dimension in their embedding vectors and adaptive metrics based on data distribution. With these scores, it is better to train a graph encoder and obtain representative embeddings. Experimental results show that GRAM has strong competitiveness in multiple tasks.Keywords
Funding Information
- National Natural Science Foundation of China (62076065)
- Natural Science Foundation of Fujian Province (2020J01495)
This publication has 29 references indexed in Scilit:
- A Comprehensive Survey of Graph Embedding: Problems, Techniques, and ApplicationsIEEE Transactions on Knowledge and Data Engineering, 2018
- Local Higher-Order Graph Clustering2017
- LINE2015
- DeepWalk2014
- Tensor Learning for RegressionIEEE Transactions on Image Processing, 2011
- Cosine Similarity Metric Learning for Face Verification2011
- The Graph Neural Network ModelIEEE Transactions on Neural Networks, 2008
- Collective Classification in Network DataAI Magazine, 2008
- Reducing the Dimensionality of Data with Neural NetworksScience, 2006
- Dimensionality Reduction by Learning an Invariant Mapping2006