A Generalized Fellegi–Sunter Framework for Multiple Record Linkage With Application to Homicide Record Systems
- 2 January 2013
- journal article
- research article
- Published by Taylor & Francis in Journal of the American Statistical Association
- Vol. 108 (502) , 385-397
Abstract
We present a probabilistic method for linking multiple datafiles. This task is not trivial in the absence of unique identifiers for the individuals recorded. This is a common scenario when linking census data to coverage measurement surveys for census coverage evaluation, and in general when multiple record systems need to be integrated for posterior analysis. Our method generalizes the Fellegi–Sunter theory for linking records from two datafiles and its modern implementations. The goal of multiple record linkage is to classify the record K-tuples coming from K datafiles according to the different matching patterns. Our method incorporates the transitivity of agreement in the computation of the data used to model matching probabilities. We use a mixture model to fit matching probabilities via maximum likelihood using the Expectation–Maximization algorithm. We present a method to decide the record K-tuples membership to the subsets of matching patterns and we prove its optimality. We apply our method to the integration of the three Colombian homicide record systems and perform a simulation study to explore the performance of the method under measurement error and different scenarios. The proposed method works well and opens new directions for future research.Keywords
All Related Versions
This publication has 23 references indexed in Scilit:
- A Survey of Indexing Techniques for Scalable Record Linkage and DeduplicationIEEE Transactions on Knowledge and Data Engineering, 2011
- Record linkageWIREs Computational Statistics, 2010
- Integrated methodology for multiple systems estimation and record linkage using a missing data formulationAStA Advances in Statistical Analysis, 2008
- Regression Analysis With Linked DataJournal of the American Statistical Association, 2005
- A Method for Calibrating False-Match Rates in Record LinkageJournal of the American Statistical Association, 1995
- The Urge to MergeMedical Care, 1994
- A Three-Sample Multiple-Recapture Approach to Census Population Estimation with Heterogeneous CatchabilityJournal of the American Statistical Association, 1993
- The 1990 Post-Enumeration Survey: Operations and ResultsJournal of the American Statistical Association, 1993
- Advances in Record-Linkage Methodology as Applied to Matching the 1985 Census of Tampa, FloridaJournal of the American Statistical Association, 1989
- A Theory for Record LinkageJournal of the American Statistical Association, 1969