Linear calibrations in chromatography: The incorrect use of ordinary least squares for determinations at low levels, and the need to redefine the limit of quantification with this regression model
- 6 April 2020
- journal article
- research article
- Published by Wiley in Journal of Separation Science
- Vol. 43 (13) , 2708-2717
Abstract
Ordinary least squares is widely applied as the standard regression method for analytical calibrations, and it is usually accepted that this regression method can be used for quantification starting at the limit of quantification. However, it requires calibration being homoscedastic and this is not common. Different calibrations have been evaluated to assess whether ordinary least squares is adequate to quantify estimates at low levels. All calibrations evaluated were linear and heteroscedastic. Despite acceptable values for precision at limit of quantification levels were obtained, ordinary least squares fitting resulted in significant and unacceptable bias at low levels. When weighted least squares regression was applied, bias at low levels was solved and accurate estimates were obtained. With heteroscedastic calibrations, limit values determined by conventional methods are only appropriate if weighted least squares are used. A “practical limit of quantification” can be determined with ordinary least squares in heteroscedastic calibrations, which should be fixed at a minimum of 20 times the value calculated with conventional methods. Biases obtained above this “practical limit” were acceptable applying ordinary least squares and no significant differences were obtained between the estimates measured using weighted and ordinary least squares when analyzing real‐world samples.Keywords
This publication has 39 references indexed in Scilit:
- Determination of enantiomeric purity of S‐amlodipine by chiral LC with emphasis on reversal of enantiomer elution orderJournal of Separation Science, 2011
- About estimating the limit of detection of heteroscedastic analytical systemsAnalytica Chimica Acta, 2009
- Quantitation of the main constituents of vanilla by reverse phase HPLC and ultra‐high‐pressure‐liquid‐chromatography with UV detection: Method validation and performance comparisonJournal of Separation Science, 2009
- Harmonization of strategies for the validation of quantitative analytical proceduresJournal of Pharmaceutical and Biomedical Analysis, 2007
- Harmonization of strategies for the validation of quantitative analytical proceduresJournal of Pharmaceutical and Biomedical Analysis, 2007
- A procedure to assess linearity by ordinary least squares methodAnalytica Chimica Acta, 2005
- Experimental Comparison of the Different Approaches To Estimate LOD and LOQ of an HPLC MethodAnalytical Chemistry, 1999
- The SFSTP guide on the validation of chromatographic methods for drug bioanalysis: from the Washington Conference to the laboratoryAnalytica Chimica Acta, 1999
- The effects of errors in measuring the independent variable in least-squares regression analysisAnalytica Chimica Acta, 1984
- Robust Tests for the Equality of VariancesJournal of the American Statistical Association, 1974