Deep Neural Network Based Relation Extraction: An Overview
Preprint
Abstract
Knowledge is a formal way of understanding the world, providing a human-level cognition and intelligence for the next-generation artificial intelligence (AI). One of the representations of knowledge is semantic relations between entities. An effective way to automatically acquire this important knowledge, called Relation Extraction (RE), a sub-task of information extraction, plays a vital role in Natural Language Processing (NLP). Its purpose is to identify semantic relations between entities from natural language text. To date, there are several studies for RE in previous works, which have documented these techniques based on Deep Neural Networks (DNNs) become a prevailing technique in this research. Especially, the supervised and distant supervision methods based on DNNs are the most popular and reliable solutions for RE. This article 1) introduces some general concepts, and further 2) gives a comprehensive overview of DNNs in RE from two points of view: supervised RE, which attempts to improve the standard RE systems, and distant supervision RE, which adopts DNNs to design sentence encoder and de-noise method. We further 3) cover some novel methods and recent trends as well as discuss possible future research directions for this task.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- Joint Entity and Relation Extraction with a Hybrid Transformer and Reinforcement Learning Based ModelProceedings of the AAAI Conference on Artificial Intelligence, 2020
- A Single Attention-Based Combination of CNN and RNN for Relation ClassificationIEEE Access, 2019
- Multi-Gram CNN-Based Self-Attention Model for Relation ClassificationIEEE Access, 2018
- Graph Convolution over Pruned Dependency Trees Improves Relation Extraction2018
- Attention-Based Capsule Networks with Dynamic Routing for Relation Extraction2018
- Multi-Level Structured Self-Attentions for Distantly Supervised Relation Extraction2018
- A neural joint model for entity and relation extraction from biomedical textBMC Bioinformatics, 2017
- Jointly Extracting Relations with Class Ties via Effective Deep Ranking2017
- Joint Extraction of Entities and Relations Based on a Novel Tagging Scheme2017
- End-to-End Relation Extraction using LSTMs on Sequences and Tree Structures2016