DEEDP: Document-Level Event Extraction Model Incorporating Dependency Paths
Open Access
- 22 February 2023
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 13 (5) , 2846
Abstract
Document-level event extraction (DEE) aims at extracting event records from given documents. Existing DEE methods handle troublesome challenges by using multiple encoders and casting the task into a multi-step paradigm. However, most of the previous approaches ignore a missing feature by using mean pooling or max pooling operations in different encoding stages and have not explicitly modeled the interdependency features between input tokens, and thus the long-distance problem cannot be solved effectively. In this study, we propose Document-level Event Extraction Model Incorporating Dependency Paths (DEEDP), which introduces a novel multi-granularity encoder framework to tackle the aforementioned problems. Specifically, we first designed a Transformer-based encoder, Transformer-M, by adding a Syntactic Feature Attention mechanism to the Transformer, which can capture more interdependency information between input tokens and help enhance the semantics for sentence-level representations of entities. We then stacked Transformer-M and Transformer to integrate sentence-level and document-level features; we thus obtained semantic enhanced document-aware representations for each entity and model long-distance dependencies between arguments. Experimental results on the benchmarks MUC-4 and ChFinAnn demonstrate that DEEDP achieves superior performance over the baselines, proving the effectiveness of our proposed methods.Keywords
Funding Information
- National Natural Science Foundation of China (62102183, BK20180462, 30920021141)
- Natural Science Foundation of Jiangsu Province (62102183, BK20180462, 30920021141)
- Fundamental Research Funds for the Central Universities (62102183, BK20180462, 30920021141)
This publication has 30 references indexed in Scilit:
- Syntax grounded graph convolutional network for joint entity and event extractionNeurocomputing, 2021
- Joint event extraction along shortest dependency paths using graph convolutional networksKnowledge-Based Systems, 2020
- SpanBERT: Improving Pre-training by Representing and Predicting SpansTransactions of the Association for Computational Linguistics, 2020
- Graph Convolution Over Multiple Latent Context-Aware Graph Structures for Event DetectionIEEE Access, 2020
- DeepEventMine: end-to-end neural nested event extraction from biomedical textsBioinformatics, 2020
- FBSN: A hybrid fine-grained neural network for biomedical event trigger identificationNeurocomputing, 2020
- Make It Directly: Event Extraction Based on Tree-LSTM and Bi-GRUIEEE Access, 2020
- Interactive learning for joint event and relation extractionInternational Journal of Machine Learning and Cybernetics, 2019
- A language-independent neural network for event detectionScience China Information Sciences, 2018
- Joint Argument Inference in Chinese Event Extraction with Argument Consistency and Event RelevanceIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2015