Robust and Scalable Entity Alignment in Big Data
Preprint
Abstract
Entity alignment has always had significant uses within a multitude of diverse scientific fields. In particular, the concept of matching entities across networks has grown in significance in the world of social science as communicative networks such as social media have expanded in scale and popularity. With the advent of big data, there is a growing need to provide analysis on graphs of massive scale. However, with millions of nodes and billions of edges, the idea of alignment between a myriad of graphs of similar scale using features extracted from potentially sparse or incomplete datasets becomes daunting. In this paper we will propose a solution to the issue of large-scale alignments in the form of a multi-step pipeline. Within this pipeline we introduce scalable feature extraction for robust temporal attributes, accompanied by novel and efficient clustering algorithms in order to find groupings of similar nodes across graphs. The features and their clusters are fed into a versatile alignment stage that accurately identifies partner nodes among millions of possible matches. Our results show that the pipeline can process large data sets, achieving efficient runtimes within the memory constraints.Keywords
All Related Versions
This publication has 8 references indexed in Scilit:
- Vertex nomination via seeded graph matchingStatistical Analysis and Data Mining: An ASA Data Science Journal, 2020
- A stratified sampling based clustering algorithm for large-scale dataKnowledge-Based Systems, 2019
- Ontology alignment in the biomedical domain using entity definitions and context2018
- Iterative big data clustering algorithms: a reviewSoftware: Practice and Experience, 2015
- The VAST Challenge: history, scope, and outcomes: An introduction to the Special IssueInformation Visualization, 2013
- Message-Passing Algorithms for Sparse Network AlignmentACM Transactions on Knowledge Discovery From Data, 2013
- IsoRankN: spectral methods for global alignment of multiple protein networksBioinformatics, 2009
- Robust Bilingual Word Alignment for Machine Aided Translation1999