Few-Shot Relation Extraction With Dual Graph Neural Network Interaction
- 2 June 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 35 (10) , 14396-14408
Abstract
Recent advances in relation extraction with deep neural architectures have achieved excellent performance. However, current models still suffer from two main drawbacks: 1) they require enormous volumes of training data to avoid model overfitting and 2) there is a sharp decrease in performance when the data distribution during training and testing shift from one domain to the other. It is thus vital to reduce the data requirement in training and explicitly model the distribution difference when transferring knowledge from one domain to another. In this work, we concentrate on few-shot relation extraction under domain adaptation settings. Specifically, we propose, a novel graph neural network (GNN) based approach for few-shot relation extraction. leverages an edge-labeling dual graph (i.e. an instance graph and a distribution graph) to explicitly model the intraclass similarity and interclass dissimilarity in each individual graph, as well as the instance-level and distribution-level relations across graphs. A dual graph interaction mechanism is proposed to adequately fuse the information between the two graphs in a cyclic flow manner. We extensively evaluate on FewRel1.0 and FewRel2.0 benchmarks under four few-shot configurations. The experimental results demonstrate that can match or outperform previously published approaches. We also perform experiments to further investigate the parameter settings and architectural choices, and we offer a qualitative analysis.Keywords
This publication has 58 references indexed in Scilit:
- MetaNER: Named Entity Recognition with Meta-Learning2020
- Evidence Integration for Multi-Hop Reading Comprehension With Graph Neural NetworksIEEE Transactions on Knowledge and Data Engineering, 2020
- GraphInception: Convolutional Neural Networks for Collective Classification in Heterogeneous Information NetworksIEEE Transactions on Knowledge and Data Engineering, 2019
- Edge-Labeling Graph Neural Network for Few-Shot Learning2019
- Relation Extraction Using Distant SupervisionACM Computing Surveys, 2018
- Learning to Compare: Relation Network for Few-Shot Learning2018
- Distantly supervised Web relation extraction for knowledge base populationSemantic Web: – Interoperability, Usability, Applicability, 2016
- A Survey on Transfer LearningIEEE Transactions on Knowledge and Data Engineering, 2009
- The Graph Neural Network ModelIEEE Transactions on Neural Networks, 2008
- Open information extraction from the webCommunications of the ACM, 2008