K-EPIC: Entity-Perceived Context Representation in Korean Relation Extraction
Open Access
- 3 December 2021
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 11 (23) , 11472
Abstract
Relation Extraction (RE) aims to predict the correct relation between two entities from the given sentence. To obtain the proper relation in Relation Extraction (RE), it is significant to comprehend the precise meaning of the two entities as well as the context of the sentence. In contrast to the RE research in English, Korean-based RE studies focusing on the entities and preserving Korean linguistic properties rarely exist. Therefore, we propose K-EPIC (Entity-Perceived Context representation in Korean) to ensure enhanced capability for understanding the meaning of entities along with considering linguistic characteristics in Korean. We present the experimental results on the BERT-Ko-RE and KLUE-RE datasets with four different types of K-EPIC methods, utilizing entity position tokens. To compare the ability of understanding entities and context of Korean pre-trained language models, we analyze HanBERT, KLUE-BERT, KoBERT, KorBERT, KoELECTRA, and multilingual-BERT (mBERT). The experimental results demonstrate that the F1 score increases significantly with our K-EPIC and that the performance of the language models trained with the Korean corpus outperforms the baseline.Keywords
Funding Information
- National Research Foundation of Korea (NRF-2021R1A6A1A03045425)
- Institute for Information communications Technology Planning Evaluation(IITP) (IITP-2021-2020-0-01819)
This publication has 13 references indexed in Scilit:
- GREG: A Global Level Relation Extraction with Knowledge Graph EmbeddingApplied Sciences, 2020
- Joint Constrained Learning for Event-Event Relation Extraction2020
- LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention2020
- Semantic relation extraction using sequential and tree-structured LSTM with attentionInformation Sciences, 2020
- Relation Extraction Using Distant SupervisionACM Computing Surveys, 2018
- SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processing2018
- Neural Machine Translation of Rare Words with Subword Units2016
- Effective Crowd Annotation for Relation Extraction2016
- Distant supervision for relation extraction without labeled data2009
- Combining lexical, syntactic, and semantic features with maximum entropy models for extracting relations2004