EXPRESS: Data Adequacy Testing for Partial Least Squares Discriminant Analysis Using Raman Spectra
- 25 March 2026
- journal article
- Published by SAGE Publications in Applied Spectroscopy
- Vol. 80 (7) , 705-719
Abstract
Partial least squares discriminant analysis (PLS-DA) is often used for data sets that consist of a large number of potential predictors but relatively few observations such that chance correlations between predictors and response can occur that lead to false conclusions. Hence, there is a need for data adequacy testing before model building but currently no such method exists. In this work we propose one where we used random permutations to destroy the correlation structure between predictor and response data. This produced normal distributions of chance correlation coefficients that were used to find correlation coefficients in the non-permuted data that differed significantly from chance occurrences. Based on these distributions, we defined two novel null hypotheses to control for when a true null hypothesis is incorrectly rejected and the other for when a false null hypothesis is not rejected. To counter false positive errors, the standard significance levels were adjusted with predictor-based Bonferroni corrections. To counter false negative errors, we compared the true and permuted correlation coefficients in distribution tails. The outcomes of the hypothesis tests then indicated whether or not PLS-DA models could be successfully built from these data sets. We also investigated how to determine the number of samples needed for a data set with a given number of predictors. Simulations showed that our method produced significantly fewer false positives than PLS-DA ( P = 0.0018, our method error rate 12× less than PLS-DA error rate) but significantly more false negatives ( P = 0.0003, our method error rate 4.5× more than PLS-DA error rate). Data from Raman spectroscopy showed that the method transferred to real data. By pre-screening such data, our method can aid in assessing whether to proceed with model building and, when there is a need to increase the sample size, we show by how much.Keywords
Funding Information
- Natural Sciences and Engineering Research Council of Canada
- National Research Council Canada
This publication has 38 references indexed in Scilit:
- Migrating from partial least squares discriminant analysis to artificial neural networks: a comparison of functionally equivalent visualisation and feature contribution tools using jupyter notebooksMetabolomics, 2020
- Overoptimism in cross-validation when using partial least squares-discriminant analysis for omics data: a systematic studyAnalytical and Bioanalytical Chemistry, 2018
- Partial least squares discriminant analysis: taking the magic awayJournal of Chemometrics, 2014
- Multiple hypothesis testing in genomicsStatistics in Medicine, 2014
- Double-check: validation of diagnostic statistics for PLS-DA models in metabolomics studiesMetabolomics, 2011
- Partial least squares regression and projection on latent structure regression (PLS Regression)WIREs Computational Statistics, 2010
- Discriminant Q2 (DQ2) for improved discrimination in PLSDA modelsMetabolomics, 2008
- Assessment of PLSDA cross validationMetabolomics, 2008
- Choosing the number of factors in partial least squares regression: estimating and minimizing the mean squared error of predictionJournal of Chemometrics, 2000
- SIMPLS: An alternative approach to partial least squares regressionChemometrics and Intelligent Laboratory Systems, 1993