MRE: A translational knowledge graph completion model based on multiple relation embedding
Authors:
Open Access
- 1 January 2023
- journal article
- research article
- Published by American Institute of Mathematical Sciences (AIMS) in Mathematical Biosciences and Engineering
- Vol. 20 (3) , 5881-5900
Abstract
Knowledge graph completion (KGC) has attracted significant research interest in applying knowledge graphs (KGs). Previously, many works have been proposed to solve the KGC problem, such as a series of translational and semantic matching models. However, most previous methods suffer from two limitations. First, current models only consider the single form of relations, thus failing to simultaneously capture the semantics of multiple relations (direct, multi-hop and rule-based). Second, the data-sparse problem of knowledge graphs would make part of relations challenging to embed. This paper proposes a novel translational knowledge graph completion model named multiple relation embedding (MRE) to address the above limitations. We attempt to embed multiple relations to provide more semantic information for representing KGs. To be more specific, we first leverage PTransE and AMIE+ to extract multi-hop and rule-based relations. Then, we propose two specific encoders to encode extracted relations and capture semantic information of multiple relations. We note that our proposed encoders can achieve interactions between relations and connected entities in relation encoding, which is rarely considered in existing methods. Next, we define three energy functions to model KGs based on the translational assumption. At last, a joint training method is adopted to perform KGC. Experimental results illustrate that MRE outperforms other baselines on KGC, demonstrating the effectiveness of embedding multiple relations for advancing knowledge graph completion.Keywords
This publication has 25 references indexed in Scilit:
- EXplainable Neural-Symbolic Learning (X-NeSyL) methodology to fuse deep learning representations with expert knowledge graphs: The MonuMAI cultural heritage use caseInformation Fusion, 2022
- MMKRL: A robust embedding approach for multi-modal knowledge graph representation learningApplied Intelligence, 2021
- Developing a BERT based triple classification model using knowledge graph embedding for question answering systemApplied Intelligence, 2021
- A deep embedding model for knowledge graph completion based on attention mechanismNeural Computing and Applications, 2021
- PMO: A knowledge representation model towards precision medicineMathematical Biosciences and Engineering, 2020
- FRS: A simple knowledge graph embedding model for entity predictionMathematical Biosciences and Engineering, 2019
- Never-ending learningCommunications of the ACM, 2018
- Fast rule mining in ontological knowledge bases with AMIE $+$ +The VLDB Journal, 2015
- Modeling Relation Paths for Representation Learning of Knowledge Bases2015
- Freebase2008