Semantic-guided attention and adaptive gating for document-level relation extraction
Authors:
Open Access
- 4 November 2024
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 14 (1) , 1-11
Abstract
In natural language processing, document-level relation extraction is a complex task that aims to predict the relationships among entities by capturing contextual interactions from an unstructured document. Existing graph- and transformer-based models capture long-range relational facts across sentences. However, they still cannot fully exploit the semantic information from multiple interactive sentences, resulting in the exclusion of influential sentences for related entities. To address this problem, a novel Semantic-guided Attention and Adaptively Gated (SAAG) model is developed for document-level relation extraction. First, a semantic-guided attention module is designed to guide sentence representation by assigning different attention scores to different words. The multihead attention mechanism is then used to capture the attention of different subspaces further to generate a document context representation. Finally, the SAAG model exploits the semantic information by leveraging a gating mechanism that can dynamically distinguish between local and global contexts. The experimental results demonstrate that the SAAG model outperforms previous models on two public datasets.Keywords
Funding Information
- Henan Open University Doctoral Research Initiation Fund Project (BSJH-2024-01)
- Henan Open University Horizontal Research Project (HXKT-202205)
This publication has 33 references indexed in Scilit:
- Document-level relation extraction with three channelsKnowledge-Based Systems, 2023
- Document-level Relation Extraction with Relation CorrelationsNeural Networks, 2023
- Collective prompt tuning with relation inference for document-level relation extractionInformation Processing & Management, 2023
- Document-Level Relation Extraction with Cross-sentence Reasoning Graph2023
- Document-level relation extraction using evidence reasoning on RST-GRAPHKnowledge-Based Systems, 2021
- Document-level relation extraction with Entity-Selection AttentionInformation Sciences, 2021
- CauseRec: Counterfactual User Sequence Synthesis for Sequential Recommendation2021
- Graph-based reasoning model for multiple relation extractionNeurocomputing, 2020
- BioCreative V CDR task corpus: a resource for chemical disease relation extractionDatabase: The Journal of Biological Databases and Curation, 2016
- Bidirectional recurrent neural networksIEEE Transactions on Signal Processing, 1997