Task-Equivariant Graph Few-shot Learning
Open Access
- 4 August 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1120-1131
Abstract
Although Graph Neural Networks (GNNs) have been successful in node classification tasks, their performance heavily relies on the availability of a sufficient number of labeled nodes per class. In real-world situations, not all classes have many labeled nodes and there may be instances where the model needs to classify new classes, making manual labeling difficult. To solve this problem, it is important for GNNs to be able to classify nodes with a limited number of labeled nodes, known as few-shot node classification. Previous episodic meta-learning based methods have demonstrated success in few-shot node classification, but our findings suggest that optimal performance can only be achieved with a substantial amount of diverse training meta-tasks. To address this challenge of meta-learning based few-shot learning (FSL), we propose a new approach, the Task-Equivariant Graph few-shot learning (TEG) framework. Our TEG framework enables the model to learn transferable task-adaptation strategies using a limited number of training meta-tasks, allowing it to acquire meta-knowledge for a wide range of meta-tasks. By incorporating equivariant neural networks, TEG can utilize their strong generalization abilities to learn highly adaptable task-specific strategies. As a result, TEG achieves state-of-the-art performance with limited training meta-tasks. Our experiments on various benchmark datasets demonstrate TEG's superiority in terms of accuracy and generalization ability, even when using minimal meta-training data, highlighting the effectiveness of our proposed approach in addressing the challenges of meta-learning based few-shot node classification. Our code is available at the following link: https://github.com/sung-won-kim/TEGKeywords
All Related Versions
Funding Information
- Institute of Information & communications Technology Planning & Evaluation (IITP) grant funded by the Korea government(MSIT) (No.2022-0-00157 and No.2022-0-00077)
This publication has 20 references indexed in Scilit:
- TAdaNet: Task-Adaptive Network for Graph-Enriched Meta-Learning2020
- A Comprehensive Survey on Graph Neural NetworksIEEE Transactions on Neural Networks and Learning Systems, 2020
- Meta-GNN2019
- Graph embedding on biomedical networks: methods, applications and evaluationsBioinformatics, 2019
- Learning to Compare: Relation Network for Few-Shot Learning2018
- Inferring Networks of Substitutable and Complementary Products2015
- An Overview of Microsoft Academic Service (MAS) and Applications2015
- Latent feature learning in social media network2013
- Exploring Context and Content Links in Social Media: A Latent Space MethodIEEE Transactions on Pattern Analysis and Machine Intelligence, 2011
- ArnetMiner2008