Multilingual Knowledge Graph Completion via Efficient Multilingual Knowledge Sharing
Preprint
Abstract
Large language models (LLMs) based Multilingual Knowledge Graph Completion (MKGC) aim to predict missing facts by leveraging LLMs' multilingual understanding capabilities, improving the completeness of multilingual knowledge graphs (KGs). However, existing MKGC research underutilizes the multilingual capabilities of LLMs and ignores the shareability of cross-lingual knowledge. In this paper, we propose a novel MKGC framework that leverages multilingual shared knowledge to significantly enhance performance through two components: Knowledge-level Grouped Mixture of Experts (KL-GMoE) and Iterative Entity Reranking (IER). KL-GMoE efficiently models shared knowledge, while IER significantly enhances its utilization. To evaluate our framework, we constructed a mKG dataset containing 5 languages and conducted comprehensive comparative experiments with existing state-of-the-art (SOTA) MKGC method. The experimental results demonstrate that our framework achieves improvements of 5.47%, 3.27%, and 1.01% in the Hits@1, Hits@3, and Hits@10 metrics, respectively, compared with SOTA MKGC method. Further experimental analysis revealed the properties of knowledge sharing in settings of unseen and unbalanced languages. We have released the dataset and code for our work on https://github.com/gaoxiaofei07/KL-GMoE.Keywords
All Related Versions
This publication has 11 references indexed in Scilit:
- MKE-PLLM: A benchmark for multilingual knowledge editing on pretrained large language modelNeurocomputing, 2025
- KICGPT: Large Language Model with Knowledge in Context for Knowledge Graph Completion2023
- Multilingual Knowledge Graph Completion from Pretrained Language Models with Knowledge Constraints2023
- From Discrimination to Generation: Knowledge Graph Completion with Generative Transformer2022
- Prix-LM: Pretraining for Multilingual Knowledge Base Construction2022
- Sequence-to-Sequence Knowledge Graph Completion and Question Answering2022
- Knowledge graphs 2021Proceedings of the VLDB Endowment, 2021
- A Survey on Knowledge Graphs: Representation, Acquisition, and ApplicationsIEEE Transactions on Neural Networks and Learning Systems, 2021
- KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language RepresentationTransactions of the Association for Computational Linguistics, 2021
- WikidataCommunications of the ACM, 2014