Event co-occurrences for prompt-based generative event argument extraction
Authors:
Open Access
- 28 December 2024
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 14 (1) , 1-17
Abstract
Recent works have introduced prompt learning for Event Argument Extraction (EAE) since prompt-based approaches transform downstream tasks into a more consistent format with the training task of Pre-trained Language Model (PLM). This helps bridge the gap between downstream tasks and model training. However, these previous works overlooked the complex number of events and their relationships within sentences. In order to address this issue, we propose Event Co-occurrences Prefix Event Argument Extraction (ECPEAE). ECPEAE utilizes the co-occurrences events prefixes module to incorporate template information corresponding to all events present in the current input as prefixes. These co-occurring event knowledge assist the model in handling complex event relationships. Additionally, to emphasize the template corresponding to the current event being extracted and enhance its constraint on the output format, we employ the present event bias module to integrate the template information into the calculation of attention at each layer of the model. Furthermore, we introduce an adjustable copy mechanism to overcome potential noise introduced by the additional information in the attention calculation at each layer. We validate our model using two widely used EAE datasets, ACE2005-EN and ERE-EN. Experimental results demonstrate that our ECPEAE model achieves state-of-the-art performance on both the ACE2005-EN dataset and the ERE dataset. Additionally, according to the results, our model also can be adapted to the low resource environment of different training sizes effectively.Keywords
Funding Information
- Tianshan Talent (No. 2022TSYCLJ0037, No. 2022TSYCLJ0037, No. 2022TSYCLJ0037, No. 2022TSYCLJ0037, No. 2022TSYCLJ0037)
- National Natural Science Foundation of China (No. 62262065, No. 62262065, No. 62262065, No. 62262065, No. 62262065)
- Science and Technology Program of Xinjiang (No. 2022B01008, No. 2022B01008, No. 2022B01008, No. 2022B01008, No. 2022B01008)
This publication has 43 references indexed in Scilit:
- A multi-graph representation for event extractionArtificial Intelligence, 2024
- Prompt for extraction: Multiple templates choice model for event extractionKnowledge-Based Systems, 2024
- Knowledge-enhanced event relation extraction via event ontology promptInformation Fusion, 2023
- Question-aware dynamic scene graph of local semantic representation learning for visual question answeringPattern Recognition Letters, 2023
- Memory-Aware Attentive Control for Community Question Answering With Knowledge-Based Dual RefinementIEEE Transactions on Systems, Man, and Cybernetics: Systems, 2023
- Implicit Event Argument Extraction With Argument-Argument Relational KnowledgeIEEE Transactions on Knowledge and Data Engineering, 2022
- Event-QA2020
- Diagnostic Prediction with Sequence-of-sets Representation Learning for Clinical Events2020
- A tree-based neural network model for biomedical event trigger detectionInformation Sciences, 2020
- Building event-centric knowledge graphs from newsJournal of Web Semantics, 2016