Differentially Private Federated Knowledge Graphs Embedding
Authors:
Open Access
- 26 October 2021
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1416-1425
Abstract
Knowledge graph embedding plays an important role in knowledge representation, reasoning, and data mining applications. However, for multiple cross-domain knowledge graphs, state-of-the-art embedding models cannot make full use of the data from different knowledge domains while preserving the privacy of exchanged data. In addition, the centralized embedding model may not scale to the extensive real-world knowledge graphs. Therefore, we propose a novel decentralized scalable learning framework, Federated Knowledge Graphs Embedding (FKGE), where embeddings from different knowledge graphs can be learnt in an asynchronous and peer-to-peer manner while being privacy-preserving. FKGE exploits adversarial generation between pairs of knowledge graphs to translate identical entities and relations of different domains into near embedding spaces. In order to protect the privacy of the training data, FKGE further implements a privacy-preserving neural network structure to guarantee no raw data leakage. We conduct extensive experiments to evaluate FKGE on 11 knowledge graphs, demonstrating a significant and consistent improvement in model quality with at most 17.85% and 7.90% increases in performance on triple classification and link prediction tasks.Keywords
All Related Versions
Funding Information
- S&T Program of Hebei (20310101D)
- National Natural Science Foundation of China (U20B20536 2002007)
- Fundamental Research Funds for the Central Universities
- National Key Research and Development Program of China (208AAA0101100)
- RGC (RIF (R6020-19 and R6021-20) and GRF (16211520))
- ITC (MHKJFS (MHP/001/19))
This publication has 17 references indexed in Scilit:
- Federated Machine LearningACM Transactions on Intelligent Systems and Technology, 2019
- Knowledge Graph Embedding: A Survey of Approaches and ApplicationsIEEE Transactions on Knowledge and Data Engineering, 2017
- A Review of Relational Machine Learning for Knowledge GraphsProceedings of the IEEE, 2015
- Lexvo.org: Language-related information for the Linguistic Linked Data cloudSemantic Web: – Interoperability, Usability, Applicability, 2015
- Knowledge Graph Embedding via Dynamic Mapping Matrix2015
- WikidataCommunications of the ACM, 2014
- Assessment of the accuracy of GeoNames gazetteer data2013
- Freebase2008
- Yago2007
- Federated database systems for managing distributed, heterogeneous, and autonomous databasesACM Computing Surveys, 1990