TWIG-I: Embedding-Free Link Prediction and Cross-KG Transfer Learning Using a Small Neural Architecture
Open Access
- 11 September 2024
- book chapter
- Published by IOS Press
- p. 106-122
Abstract
Knowledge Graphs (KGs) are relational knowledge bases that represent facts as a set of labelled nodes and the labelled relations between them. Their machine learning counterpart, Knowledge Graph Embeddings (KGEs), learn to predict new facts based on the data contained in a KG – the so-called link prediction task. To date, almost all forms of link prediction for KGs rely on some form of embedding model, and KGEs hold state-of-the-art status for link prediction. In this paper, we present TWIG-I (Topologically-Weighted Intelligence Generation for Inference), a novel link prediction system that can represent the features of a KG in latent space without using node or edge embeddings. TWIG-I shows mixed performance relative to state-of-the-art KGE models – at times exceeding or falling short of baseline performance. However, unlike KGEs, TWIG-I can be natively used for transfer learning across distinct KGs. We show that using transfer learning with TWIG-I can lead to increases in performance in some cases both over KGE baselines and over TWIG-I models trained without finetuning. While these results are still mixed, TWIG-I clearly demonstrates that structural features are sufficient to solve the link prediction task in the absence of embeddings. Finally, TWIG-I opens up cross-KG transfer learning as a new direction in link prediction research and application.Keywords
This publication has 16 references indexed in Scilit:
- Building a knowledge graph to enable precision medicineScientific Data, 2023
- Implications of topological imbalance for representation learning on biomedical knowledge graphsBriefings in Bioinformatics, 2022
- Bringing Light Into the Dark: A Large-Scale Evaluation of Knowledge Graph Embedding Models Under a Unified FrameworkIEEE Transactions on Pattern Analysis and Machine Intelligence, 2021
- Embedding Knowledge Graphs Attentive to Positional and Centrality Qualities2021
- Knowledge GraphsACM Computing Surveys, 2021
- Graph neural networks: A review of methods and applicationsAI Open, 2020
- Knowledge Graph Embedding: A Survey of Approaches and ApplicationsIEEE Transactions on Knowledge and Data Engineering, 2017
- DL-Learner—A framework for inductive learning on the Semantic WebJournal of Web Semantics, 2016
- A Review of Relational Machine Learning for Knowledge GraphsProceedings of the IEEE, 2015
- Fast rule mining in ontological knowledge bases with AMIE $+$ +The VLDB Journal, 2015