ASIDS: A Robust Data Synthesis Method for Generating Optimal Synthetic Samples
Open Access
- 13 September 2023
- journal article
- research article
- Published by MDPI AG in Mathematics
- Vol. 11 (18) , 3891
Abstract
Most existing data synthesis methods are designed to tackle problems with dataset imbalance, data anonymization, and an insufficient sample size. There is a lack of effective synthesis methods in cases where the actual datasets have a limited number of data points but a large number of features and unknown noise. Thus, in this paper we propose a data synthesis method named Adaptive Subspace Interpolation for Data Synthesis (ASIDS). The idea is to divide the original data feature space into several subspaces with an equal number of data points, and then perform interpolation on the data points in the adjacent subspaces. This method can adaptively adjust the sample size of the synthetic dataset that contains unknown noise, and the generated sample data typically contain minimal errors. Moreover, it adjusts the feature composition of the data points, which can significantly reduce the proportion of the data points with large fitting errors. Furthermore, the hyperparameters of this method have an intuitive interpretation and usually require little calibration. Analysis results obtained using simulated original data and benchmark original datasets demonstrate that ASIDS is a robust and stable method for data synthesis.Keywords
Funding Information
- National Social Science Fund of China (22BTJ021)
This publication has 25 references indexed in Scilit:
- Objective Bayesian Model Selection in Generalized Additive Models With Penalized SplinesJournal of Computational and Graphical Statistics, 2015
- Technical Note: Comparing the effectiveness of recent algorithms to fill and smooth incomplete and noisy time seriesAtmospheric Chemistry and Physics, 2011
- The Runge phenomenon and spatially variable shape parameters in RBF interpolationComputers & Mathematics with Applications, 2007
- Multidimensional Spline Interpolation: Theory and ApplicationsComputational Economics, 2007
- Borderline-SMOTE: A New Over-Sampling Method in Imbalanced Data Sets Learning2005
- Linear Interpolation RevitalizedIEEE Transactions on Image Processing, 2004
- Barycentric Lagrange InterpolationSIAM Review, 2004
- The Bernstein Constant and Polynomial Interpolation at the Chebyshev NodesJournal of Approximation Theory, 2002
- Piecewise Linear Interpolation With Nonequidistant NodesNumerical Functional Analysis and Optimization, 2000
- Robust Locally Weighted Regression and Smoothing ScatterplotsJournal of the American Statistical Association, 1979