Tabular and latent space synthetic data generation: a literature review
Authors:
Top Cited Papers
Open Access
- 10 July 2023
- journal article
- review article
- Published by Springer Nature in Journal of Big Data
- Vol. 10 (1) , 1-37
Abstract
The generation of synthetic data can be used for anonymization, regularization, oversampling, semi-supervised learning, self-supervised learning, and several other tasks. Such broad potential motivated the development of new algorithms, specialized in data generation for specific data formats and Machine Learning (ML) tasks. However, one of the most common data formats used in industrial applications, tabular data, is generally overlooked; Literature analyses are scarce, state-of-the-art methods are spread across domains or ML tasks and there is little to no distinction among the main types of mechanism underlying synthetic data generation algorithms. In this paper, we analyze tabular and latent space synthetic data generation algorithms. Specifically, we propose a unified taxonomy as an extension and generalization of previous taxonomies, review 70 generation algorithms across six ML problems, distinguish the main generation mechanisms identified into six categories, describe each type of generation mechanism, discuss metrics to evaluate the quality of synthetic data and provide recommendations for future research. We expect this study to assist researchers and practitioners identify relevant gaps in the literature and design better and more informed practices with synthetic data.Keywords
Funding Information
- Fundação para a Ciência e a Tecnologia (SFRH/BD/151473/2021)
- Centro de Investigação em Gestão de Informação (UIDB/04152/2020)
This publication has 111 references indexed in Scilit:
- RWO-Sampling: A random walk over-sampling approach to imbalanced data classificationInformation Fusion, 2014
- Training and assessing classification rules with imbalanced dataData Mining and Knowledge Discovery, 2012
- A few useful things to know about machine learningCommunications of the ACM, 2012
- Projections of Probability Distributions: A Measure-Theoretic Dvoretzky Theorem2012
- DBSMOTE: Density-Based Synthetic Minority Over-sampling TEchniqueApplied Intelligence, 2011
- Safe-Level-SMOTE: Safe-Level-Synthetic Minority Over-Sampling TEchnique for Handling the Class Imbalanced Problem2009
- A Framework for Evaluating the Utility of Data Altered to Protect ConfidentialityThe American Statistician, 2006
- Borderline-SMOTE: A New Over-Sampling Method in Imbalanced Data Sets Learning2005
- Emergence of invariant-feature detectors in the adaptive-subspace self-organizing mapBiological Cybernetics, 1996
- A weighted nearest neighbor algorithm for learning with symbolic featuresMachine Learning, 1993