DeNERT-KG: Named Entity and Relation Extraction Model Using DQN, Knowledge Graph, and BERT
Open Access
- 15 September 2020
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 10 (18) , 6429
Abstract
Along with studies on artificial intelligence technology, research is also being carried out actively in the field of natural language processing to understand and process people’s language, in other words, natural language. For computers to learn on their own, the skill of understanding natural language is very important. There are a wide variety of tasks involved in the field of natural language processing, but we would like to focus on the named entity registration and relation extraction task, which is considered to be the most important in understanding sentences. We propose DeNERT-KG, a model that can extract subject, object, and relationships, to grasp the meaning inherent in a sentence. Based on the BERT language model and Deep Q-Network, the named entity recognition (NER) model for extracting subject and object is established, and a knowledge graph is applied for relation extraction. Using the DeNERT-KG model, it is possible to extract the subject, type of subject, object, type of object, and relationship from a sentence, and verify this model through experiments.Keywords
Funding Information
- National Research Foundation of Korea (NRF2019R1A2C1008412)
- Institute for Information and Communications Technology Promotion (2015-0-00932)
This publication has 23 references indexed in Scilit:
- Improving Graph Convolutional Networks Based on Relation-Aware Attention for End-to-End Relation ExtractionIEEE Access, 2020
- A Deep Neural Network Model for Joint Entity and Relation ExtractionIEEE Access, 2019
- Recent Trends in Deep Learning Based Natural Language Processing [Review Article]IEEE Computational Intelligence Magazine, 2018
- Knowledge Graph Embedding: A Survey of Approaches and ApplicationsIEEE Transactions on Knowledge and Data Engineering, 2017
- Semi-supervised sequence tagging with bidirectional language models2017
- Advances in natural language processingScience, 2015
- Human-level control through deep reinforcement learningNature, 2015
- ConceptNet — A Practical Commonsense Reasoning Tool-KitBT Technology Journal, 2004
- Natural language processingCommunications of the ACM, 1996
- WordNetCommunications of the ACM, 1995