Generating synthetic identifiers to support development and evaluation of data linkage methods
Authors:
Open Access
- 9 January 2024
- journal article
- research article
- Published by Swansea University in International Journal of Population Data Science
- Vol. 9 (1) , 2389
Abstract
IntroductionCareful development and evaluation of data linkage methods is limited by researcher access to personal identifiers. One solution is to generate synthetic identifiers, which do not pose equivalent privacy concerns, but can form a 'gold-standard' linkage algorithm training dataset. Such data could help inform choices about appropriate linkage strategies in different settings. ObjectivesWe aimed to develop and demonstrate a framework for generating synthetic identifier datasets to support development and evaluation of data linkage methods. We evaluated whether replicating associations between attributes and identifiers improved the utility of the synthetic data for assessing linkage error. MethodsWe determined the steps required to generate synthetic identifiers that replicate the properties of real-world data collection. We then generated synthetic versions of a large UK cohort study (the Avon Longitudinal Study of Parents and Children; ALSPAC), according to the quality and completeness of identifiers recorded over several waves of the cohort. We evaluated the utility of the synthetic identifier data in terms of assessing linkage quality (false matches and missed matches). ResultsComparing data from two collection points in ALSPAC, we found within-person disagreement in identifiers (differences in recording due to both natural change and non-valid entries) in 18% of surnames and 12% of forenames. Rates of disagreement varied by maternal age and ethnic group. Synthetic data provided accurate estimates of linkage quality metrics compared with the original data (within 0.13-0.55% for missed matches and 0.00-0.04% for false matches). Incorporating associations between identifier errors and maternal age/ethnicity improved synthetic data utility. ConclusionsWe show that replicating dependencies between attribute values (e.g. ethnicity), values of identifiers (e.g. name), identifier disagreements (e.g. missing values, errors or changes over time), and their patterns and distribution structure enables generation of realistic synthetic data that can be used for robust evaluation of linkage methods.Keywords
This publication has 24 references indexed in Scilit:
- Assessing data linkage quality in cohort studiesAnnals of Human Biology, 2020
- Reflections on modern methods: linkage error biasInternational Journal of Epidemiology, 2019
- A guide to evaluating linkage quality for the analysis of linked dataInternational Journal of Epidemiology, 2017
- Flexible and extensible generation and corruption of personal data2013
- Opening the black box of record linkageJournal of Epidemiology and Community Health, 2012
- Cohort Profile: The Avon Longitudinal Study of Parents and Children: ALSPAC mothers cohortInternational Journal of Epidemiology, 2012
- Cohort Profile: The ‘Children of the 90s’—the index offspring of the Avon Longitudinal Study of Parents and ChildrenInternational Journal of Epidemiology, 2012
- A transparent and transportable methodology for evaluating Data Linkage softwareJournal of Biomedical Informatics, 2012
- The Swedish personal identity number: possibilities and pitfalls in healthcare and medical researchEuropean Journal of Epidemiology, 2009
- Character Recognition Systems2007