Collective entity resolution in relational data
Authors:
Top Cited Papers
Open Access
- 1 March 2007
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Knowledge Discovery From Data
- Vol. 1 (1)
Abstract
Many databases contain uncertain and imprecise references to real-world entities. The absence of identifiers for the underlying entities often results in a database which contains multiple references to the same entity. This can lead not only to data redundancy, but also inaccuracies in query processing and knowledge extraction. These problems can be alleviated through the use of entity resolution . Entity resolution involves discovering the underlying entities and mapping each database reference to these entities. Traditionally, entities are resolved using pairwise similarity over the attributes of references. However, there is often additional relational information in the data. Specifically, references to different entities may cooccur. In these cases, collective entity resolution, in which entities for cooccurring references are determined jointly rather than independently, can improve entity resolution accuracy. We propose a novel relational clustering algorithm that uses both attribute and relational information for determining the underlying domain entities, and we give an efficient implementation. We investigate the impact that different relational similarity measures have on entity resolution quality. We evaluate our collective entity resolution algorithm on multiple real-world databases. We show that it improves entity resolution performance over both attribute-based baselines and over algorithms that consider relational information but do not resolve entities collectively. In addition, we perform detailed experiments on synthetically generated data to identify data characteristics that favor collective relational resolution over purely attribute-based algorithms.Keywords
This publication has 25 references indexed in Scilit:
- Query-time entity resolution2006
- Entity Resolution in Graphs2006
- Reference reconciliation in complex information spaces2005
- Iterative record linkage for cleaning and integration2004
- Adaptive name matching in information integrationIEEE Intelligent Systems, 2003
- Adaptive duplicate detection using learnable string similarity measures2003
- Friends and neighbors on the WebSocial Networks, 2003
- Robust and efficient fuzzy match for online data cleaning2003
- Learning to match and cluster large high-dimensional data sets for data integration2002
- Data integration using similarity joins and a word-based information representation languageACM Transactions on Information Systems, 2000