Robust sparse principal component analysis: situation of full sparseness
Open Access
- 1 May 2022
- journal article
- research article
- Published by Walter de Gruyter GmbH in Journal of Applied Mathematics, Statistics and Informatics
- Vol. 18 (1) , 5-20
Abstract
Principal Component Analysis (PCA) is the main method of dimension reduction and data processing when the dataset is of high dimension. Therefore, PCA is a widely used method in almost all scientific fields. Because PCA is a linear combination of the original variables, the interpretation process of the analysis results is often encountered with some difficulties. The approaches proposed for solving these problems are called to as Sparse Principal Component Analysis (SPCA). Sparse approaches are not robust in existence of outliers in the data set. In this study, the performance of the approach proposed by Croux et al. (2013), which combines the advantageous properties of SPCA and Robust Principal Component Analysis (RPCA), will be examined through one real and three artificial datasets in the situation of full sparseness. In the light of the findings, it is recommended to use robust sparse PCA based on projection pursuit in analyzing the data. Another important finding obtained from the study is that the BIC and TPO criteria used in determining lambda are not much superior to each other. We suggest choosing one of these two criteria that give an optimal result.Keywords
This publication has 18 references indexed in Scilit:
- Principal Component Analysis With Sparse Fused LoadingsJournal of Computational and Graphical Statistics, 2010
- Shrinkage Tuning Parameter Selection with a Diverging number of ParametersJournal of the Royal Statistical Society Series B: Statistical Methodology, 2008
- High-Breakdown Robust Multivariate MethodsStatistical Science, 2008
- Algorithms for Projection–Pursuit robust principal component analysisChemometrics and Intelligent Laboratory Systems, 2007
- Sparse Principal Component AnalysisJournal of Computational and Graphical Statistics, 2006
- A Fast Algorithm for the Minimum Covariance Determinant EstimatorTechnometrics, 1999
- Loading and correlations in the interpretation of principle compenentsJournal of Applied Statistics, 1995
- Rotation of principal components: choice of normalization constraintsJournal of Applied Statistics, 1995
- Alternatives to the Median Absolute DeviationJournal of the American Statistical Association, 1993
- Projection-Pursuit Approach to Robust Dispersion Matrices and Principal Components: Primary Theory and Monte CarloJournal of the American Statistical Association, 1985