Iterative Application of UMAP-Based Algorithms for Fully Synthetic Healthcare Tabular Data Generation

Authors:
Open Access
Publisher website
Google Scholar
Abstract
Building on a previously developed partially synthetic data generation algorithm utilizing data visualization techniques, this study extends the novel algorithm to generate fully synthetic tabular healthcare data. In this enhanced form, the algorithm serves as an alternative to conventional methods based on Generative Adversarial Networks (GANs) or Variational Autoencoders (VAEs). By iteratively applying the original methodology, the adapted algorithm employs UMAP (Uniform Manifold Approximation and Projection), a dimensionality reduction technique, to validate generated samples through low-dimensional clustering. This approach has been successfully applied to three healthcare domains: prostate cancer, breast cancer, and cardiovascular disease. The generated synthetic data have been rigorously evaluated for fidelity and utility. Results show that the UMAP-based algorithm outperforms GAN- and VAE-based generation methods across different scenarios. In fidelity assessments, it achieved smaller maximum distances between the cumulative distribution functions of real and synthetic data for different attributes. In utility evaluations, the UMAP-based synthetic datasets enhanced machine learning model performance, particularly in classification tasks. In conclusion, this method represents a robust solution for generating secure, high-quality synthetic healthcare data, effectively addressing data scarcity challenges.
Funding Information
  • HORIZON EUROPE Framework Programme (101095382, MCIN/AEI/10.13039/501000011033)
  • Ministerio de Ciencia e Innovación (101095382, MCIN/AEI/10.13039/501000011033)
  • FEDER “Una manera de hacer Europa” (101095382, MCIN/AEI/10.13039/501000011033)

This publication has 40 references indexed in Scilit: