Partial least squares, Beer's law and the net analyte signal: statistical modeling and analysis
Authors:
Open Access
- 1 January 2005
- journal article
- research article
- Published by Wiley in Journal of Chemometrics
- Vol. 19 (1) , 45-54
Abstract
Partial least squares (PLS) is one of the most common regression algorithms in chemistry, relating input–output samples (xi, yi) by a linear multivariate model. In this paper we analyze the PLS algorithm under a specific probabilistic model for the relation between x and y. Following Beer's law, we assume a linear mixture model in which each data sample (x, y) is a random realization from a joint probability distribution where x is the sum of k components multiplied by their respective characteristic responses, and each of these components is a random variable. We analyze PLS on this model under two idealized settings: one is the ideal case of noise‐free samples and the other is the case of an infinite number of noisy training samples. In the noise‐free case we prove that, as expected, the regression vector computed by PLS is, up to normalization, the net analyte signal. We prove that PLS computes this vector after at most k iterations, where k is the total number of components. In the case of an infinite training set corrupted by unstructured noise, we show that PLS computes a final regression vector which is not in general purely proportional to the net analyte signal vector, but has the important property of being optimal under a mean squared error of prediction criterion. This result can be viewed as an asymptotic optimality of PLS in the limit of a very large but finite training set. Copyright © 2005 John Wiley & Sons, Ltd.Keywords
This publication has 28 references indexed in Scilit:
- Discordance between Net Analyte Signal Theory and Practical Multivariate CalibrationAnalytical Chemistry, 2004
- Theory of net analyte signal vectors in inverse regressionJournal of Chemometrics, 2003
- The Peculiar Shrinkage Properties of Partial Least Squares RegressionJournal of the Royal Statistical Society Series B: Statistical Methodology, 2000
- Wavelength Selection Characterization for NIR SpectraApplied Spectroscopy, 1997
- PLS shrinksJournal of Chemometrics, 1995
- Comparison of Prediction Methods when Only a Few Components are RelevantJournal of the American Statistical Association, 1994
- An Interpretation of Partial Least SquaresJournal of the American Statistical Association, 1994
- A Statistical View of Some Chemometrics Regression ToolsTechnometrics, 1993
- Discussion: PLS in Chemical PracticeTechnometrics, 1993
- Qualitative Information from Multivariate Calibration ModelsApplied Spectroscopy, 1990