Active Ensemble Learning for Knowledge Graph Error Detection
Open Access
- 27 February 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 877-885
Abstract
Knowledge graphs (KGs) could effectively integrate a large number of real-world assertions, and improve the performance of various applications, such as recommendation and search. KG error detection has been intensively studied since real-world KGs inevitably contain erroneous triples. While existing studies focus on developing a novel algorithm dedicated to one or a few data characteristics, we explore advancing KG error detection by assembling a set of state-of-the-art (SOTA) KG error detectors. However, it is nontrivial to develop a practical ensemble learning framework for KG error detection. Existing ensemble learning models heavily rely on labels, while it is expensive to acquire labeled errors in KGs. Also, KG error detection itself is challenging since triples contain rich semantic information and might be false because of various reasons. To this end, we propose to leverage active learning to minimize human efforts. Our proposed framework - KAEL, could effectively assemble a set of off-the-shelf error detection algorithms, by actively using a limited number of manual annotations. It adaptively updates the ensemble learning policy in each iteration based on active queries, i.e., the answers from experts. After all annotation budget is used, KAEL utilizes the trained policy to identify remaining suspicious triples. Experiments on real-world KGs demonstrate that we can achieve significant improvement when applying KAEL to assemble SOTA error detectors. KAEL also outperforms SOTA ensemble learning baselines significantly.Keywords
Funding Information
- The Hong Kong Polytechnic University (Start-up Fund (project number: P0033934))
This publication has 18 references indexed in Scilit:
- ED2: A Case for Active Learning in Error Detection2019
- Knowledge Graph Embedding Based Question Answering2019
- Detection of Relation Assertion Errors in Knowledge Graphs2017
- Knowledge Graph Embedding: A Survey of Approaches and ApplicationsIEEE Transactions on Knowledge and Data Engineering, 2017
- Ensemble-learning Approaches for Network Security and Anomaly Detection2017
- A survey of intrusion detection systems based on ensemble and hybrid classifiersComputers & Security, 2017
- Incorporating Expert Feedback into Active Anomaly Discovery2016
- Less is MoreACM Transactions on Knowledge Discovery From Data, 2016
- Learning Disjointness Axioms With Association Rule Mining and Its Application to Inconsistency Detection of Linked Data2014
- A novel framework, based on fuzzy ensemble of classifiers for intrusion detection systems2014