Fake It Till You Make It: Guidelines for Effective Synthetic Data Generation
Open Access
- 28 February 2021
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 11 (5) , 2158
Abstract
Synthetic data provides a privacy protecting mechanism for the broad usage and sharing of healthcare data for secondary purposes. It is considered a safe approach for the sharing of sensitive data as it generates an artificial dataset that contains no identifiable information. Synthetic data is increasing in popularity with multiple synthetic data generators developed in the past decade, yet its utility is still a subject of research. This paper is concerned with evaluating the effect of various synthetic data generation and usage settings on the utility of the generated synthetic data and its derived models. Specifically, we investigate (i) the effect of data pre-processing on the utility of the synthetic data generated, (ii) whether tuning should be applied to the synthetic datasets when generating supervised machine learning models, and (iii) whether sharing preliminary machine learning results can improve the synthetic data models. Lastly, (iv) we investigate whether one utility measure (Propensity score) can predict the accuracy of the machine learning models generated from the synthetic data when employed in real life. We use two popular measures of synthetic data utility, propensity score and classification accuracy, to compare the different settings. We adopt a recent mechanism for the calculation of propensity, which looks carefully into the choice of model for the propensity score calculation. Accordingly, this paper takes a new direction with investigating the effect of various data generation and usage settings on the quality of the generated data and its ensuing models. The goal is to inform on the best strategies to follow when generating and using synthetic data.Keywords
Funding Information
- UAEU UPAR Grant (31T121-UPAR)
This publication has 30 references indexed in Scilit:
- Dynamic-informed consent: A potential solution for ethical dilemmas in population sequencing initiativesComputational and Structural Biotechnology Journal, 2020
- AI-Assisted Decision-making in HealthcareAsian Bioethics Review, 2019
- The potential for artificial intelligence in healthcareFuture Healthcare Journal, 2019
- Informed Consent in Biomedical ResearchComputational and Structural Biotechnology Journal, 2019
- The development of large-scale de-identified biomedical databases in the age of genomics—principles and challengesHuman Genomics, 2018
- A risk-based framework for biomedical data sharingJournal of Biomedical Informatics, 2017
- Big Data in medical research and EU data protection law: challenges to the consent or anonymise approachEuropean Journal of Human Genetics, 2015
- Privacy in the Genomic EraACM Computing Surveys, 2015
- Developing a data infrastructure for a learning health system: the PORTAL networkJournal of the American Medical Informatics Association, 2014
- Estimating the re-identification risk of clinical data setsBMC Medical Informatics and Decision Making, 2012