So you think you can PLS-DA?
Authors:
- Daniel Ruiz-PerezDRDaniel Ruiz-Perez
- Haibin GuanHGHaibin Guan
- Purnima MadhivananPMPurnima Madhivanan
- Kalai MatheeKMKalai Mathee
- Giri NarasimhanGNGiri Narasimhan
Preprint
Abstract
Background: Partial Least-Squares Discriminant Analysis (PLS-DA) is a popular machine learning tool that is gaining increasing attention as a useful feature selector and classifier. In an effort to understand its strengths and weaknesses, we performed a series of experiments with synthetic data and compared its performance to its close relative from which it was initially invented, namely Principal Component Analysis (PCA). Results: We demonstrate that even though PCA ignores the information regarding the class labels of the samples, this unsupervised tool can be remarkably effective as a feature selector. In some cases, it outperforms PLS-DA, which is made aware of the class labels in its input. Our experiments range from looking at the signal-to-noise ratio in the feature selection task, to considering many practical distributions and models encountered when analyzing bioinformatics and clinical data. Other methods were also evaluated. Finally, we analyzed an interesting data set from 396 vaginal microbiome samples where the ground truth for the feature selection was available. All the 3D figures shown in this paper as well as the supplementary ones can be viewed interactively at http://biorg.cs.fiu.edu/plsda Conclusions: Our results highlighted the strengths and weaknesses of PLS-DA in comparison with PCA for different underlying data models.Keywords
All Related Versions
- Published version: BMC Bioinformatics, 21 (S1), 1.
This publication has 28 references indexed in Scilit:
- Temporal Dynamics of the Human Vaginal MicrobiotaScience Translational Medicine, 2012
- Sparse PLS discriminant analysis: biologically relevant feature selection and graphical displays for multiclass problemsBMC Bioinformatics, 2011
- Some common misunderstandings in chemometricsJournal of Chemometrics, 2010
- Vaginal microbiome of reproductive-age womenProceedings of the National Academy of Sciences of the United States of America, 2010
- Sparse Partial Least Squares Classification for High Dimensional DataStatistical Applications in Genetics and Molecular Biology, 2010
- Sparse Partial Least Squares Regression for Simultaneous Dimension Reduction and Variable SelectionJournal of the Royal Statistical Society Series B: Statistical Methodology, 2010
- Classification from microarray data using probabilistic discriminant partial least squares with reject optionTalanta, 2009
- Multi-class tumor classification by discriminant partial least squares using microarray gene expression data and assessment of classification modelsComputational Biology and Chemistry, 2004
- Diagnosis of Dementias Using Partial Least Squares Discriminant AnalysisDementia and Geriatric Cognitive Disorders, 1995
- Regularized Discriminant AnalysisJournal of the American Statistical Association, 1989