Multi-Task Learning and Improved TextRank for Knowledge Graph Completion
Open Access
Abstract
Knowledge graph completion is an important technology for supplementing knowledge graphs and improving data quality. However, the existing knowledge graph completion methods ignore the features of triple relations, and the introduced entity description texts are long and redundant. To address these problems, this study proposes a multi-task learning and improved TextRank for knowledge graph completion (MIT-KGC) model. The key contexts are first extracted from redundant entity descriptions using the improved TextRank algorithm. Then, a lite bidirectional encoder representations from transformers (ALBERT) is used as the text encoder to reduce the parameters of the model. Subsequently, the multi-task learning method is utilized to fine-tune the model by effectively integrating the entity and relation features. Based on the datasets of WN18RR, FB15k-237, and DBpedia50k, experiments were conducted with the proposed model and the results showed that, compared with traditional methods, the mean rank (MR), top 10 hit ratio (Hit@10), and top three hit ratio (Hit@3) were enhanced by 38, 1.3%, and 1.9%, respectively, on WN18RR. Additionally, the MR and Hit@10 were increased by 23 and 0.7%, respectively, on FB15k-237. The model also improved the Hit@3 and the top one hit ratio (Hit@1) by 3.1% and 1.5% on the dataset DBpedia50k, respectively, verifying the validity of the model.Keywords
Funding Information
- National Natural Science Foundation of China (71901215)
- National University of Defense Technology Research Project (ZK20-46)
- Young Elite Scientists Sponsorship Program (2021-JCJQ-QT-050)
This publication has 21 references indexed in Scilit:
- Automatic paper writing based on a RNN and the TextRank algorithmApplied Soft Computing, 2020
- Keyword extraction using supervised cumulative TextRankMultimedia Tools and Applications, 2020
- Path Ranking with Attention to Type HierarchiesProceedings of the AAAI Conference on Artificial Intelligence, 2020
- Multi-Documents Summarization Based on TextRank and its Application in Online Argumentation PlatformInternational Journal of Data Warehousing and Mining, 2018
- Modeling Relational Data with Graph Convolutional Networks2018
- Multi-Hop Knowledge Graph Reasoning with Reward Shaping2018
- DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoning2017
- Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation2014
- Freebase2008
- WordNetCommunications of the ACM, 1995