Variable selection for latent class analysis in the presence of missing data with application to record linkage
- 9 April 2024
- journal article
- research article
- Published by SAGE Publications in Statistical Methods in Medical Research
- Vol. 33 (6) , 966-980
Abstract
The Fellegi-Sunter model is a latent class model widely used in probabilistic linkage to identify records that belong to the same entity. Record linkage practitioners typically employ all available matching fields in the model with the premise that more fields convey greater information about the true match status and hence result in improved match performance. In the context of model-based clustering, it is well known that such a premise is incorrect and the inclusion of noisy variables could compromise the clustering. Variable selection procedures have therefore been developed to remove noisy variables. Although these procedures have the potential to improve record matching, they cannot be applied directly due to the ubiquity of the missing data in record linkage applications. In this paper, we modify the stepwise variable selection procedure proposed by Fop, Smart, and Murphy and extend it to account for missing data common in record linkage. Through simulation studies, our proposed method is shown to select the correct set of matching fields across various settings, leading to better-performing algorithms. The improved match performance is also seen in a real-world application. We therefore recommend the use of our proposed selection procedure to identify informative matching fields for probabilistic record linkage algorithms.Keywords
Funding Information
- Agency for Healthcare Research and Quality (R01HS023808)
- Patient-Centered Outcomes Research Institute (ME-2017C1-6425)
This publication has 33 references indexed in Scilit:
- Using a Probabilistic Model to Assist Merging of Large-Scale Administrative RecordsAmerican Political Science Review, 2019
- Clustering and variable selection in the presence of mixed variable types and missing dataStatistics in Medicine, 2018
- Latent Ignorability and Item Selection for Nursing Home Case-Mix EvaluationJournal of Classification, 2017
- Variable selection for model-based clustering using the integrated complete-data likelihoodStatistics and Computing, 2016
- Bayesian variable selection for latent class analysis using a collapsed Gibbs samplerStatistics and Computing, 2014
- Improving record linkage performance in the presence of missing linkage dataJournal of Biomedical Informatics, 2014
- Model-based clustering of high-dimensional data: A reviewComputational Statistics & Data Analysis, 2014
- Data Matching2012
- Latent class analysis variable selectionAnnals of the Institute of Statistical Mathematics, 2009
- Modern Applied Statistics with S2002