Unsupervised Entity Resolution With Blocking and Graph Algorithms
- 28 April 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Knowledge and Data Engineering
- Vol. 34 (3) , 1501-1515
Abstract
Entity resolution identifies all records in a database that refer to the same entity. In this paper, we propose an unsupervised framework for entity resolution using blocking and graph algorithms. The records are partitioned into blocks with no redundancy for efficiency improvement. For intra-block data processing, we propose a graph-theoretic fusion framework with two components, namely ITER and CliqueRank. Specifically, ITER constructs a weighted bipartite graph between terms and record-record pairs and iteratively propagates the node salience until convergence. Subsequently, CliqueRank constructs a record graph to estimate the likelihood of two records resident in the same clique. The derived likelihood from CliqueRank is fed back to ITER to rectify the edge weight until a joint optimum can be reached. Experimental evaluation was conducted with 4 real datasets. Results show that our unsupervised framework is comparable or even superior to state-of-the-art deep learning approaches.Keywords
Funding Information
- National Natural Science Foundation of China (61932001, 61702016)
- MOE (T1251RES1913)
This publication has 30 references indexed in Scilit:
- Crowd-Based Deduplication2015
- Crowdsourcing algorithms for entity resolutionProceedings of the VLDB Endowment, 2014
- Glove: Global Vectors for Word Representation2014
- Question selection for crowd entity resolutionProceedings of the VLDB Endowment, 2013
- Active sampling for entity matching2012
- CrowdERProceedings of the VLDB Endowment, 2012
- Adaptive name matching in information integrationIEEE Intelligent Systems, 2003
- Learning object identification rules for information integrationInformation Systems, 2001
- Data integration using similarity joins and a word-based information representation languageACM Transactions on Information Systems, 2000
- Learning string-edit distanceIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998