Application of SIC (simple interval calculation) for object status classification and outlier detection—comparison with regression approach
- 1 September 2004
- journal article
- research article
- Published by Wiley in Journal of Chemometrics
- Vol. 18 (9) , 402-413
Abstract
We introduce a novel approach termed simple interval calculation (SIC) for classification of object status in linear multivariate calibration (MVC) and other data analytical contexts. SIC is a method that directly constructs an interval estimator for the predicted response. SIC is based on the single assumption that all errors involved in MVC arelimited. We present the theory of the SIC method and explain its realization by linear programming techniques. The primary SIC consequence is a radically new object classification that can be interpreted using a two‐dimensional object status plot (OSP), ‘SIC residual vs SIC leverage’. These two new measures of prediction quality are introduced in the traditional chemometric MVC context. Simple straight demarcations divide the OSP into areas which quantitatively discriminate all objects involved in modeling and prediction into four different types:boundary samples, which are the significant objects (for generating the entire data structure) within the training subset;insiders, which are samples that comply with the model;outsiders, which are samples that have large prediction errors; and finallyoutliers, which are those samples that cannot be predicted at all with respect to a given model. We also present detailed comparisons of the new SIC approach with traditional chemometric methods applied for MVC, classification and outlier detection. These comparisons employ four real‐world data sets, selected for their particular complexities, which serve as showcases of SIC application on intricate training and test set data structures. Copyright © 2005 John Wiley & Sons, Ltd.Keywords
This publication has 23 references indexed in Scilit:
- Variable selection in random calibration of near‐infrared instruments: ridge regression and partial least squares regression settingsJournal of Chemometrics, 2003
- Variable Selection in near Infrared Spectroscopy Based on Significance Testing in Partial Least Squares RegressionJournal of Near Infrared Spectroscopy, 2000
- Characterisation of the representativity of selected sets of samples in multivariate calibration and pattern recognitionAnalytica Chimica Acta, 1997
- Standardisation of near-infrared spectrometric instruments: A reviewVibrational Spectroscopy, 1996
- Treatment of Model Error in Calibration by Robust and Fuzzy ProceduresAnalytical Letters, 1994
- Multivariate instrument standardizationAnalytical Chemistry, 1991
- Influential Observations and Outliers in RegressionTechnometrics, 1981
- Influential Observations in Linear RegressionJournal of the American Statistical Association, 1979
- Asymptotic Normality and Consistency of the Least Squares Estimators for Families of Linear RegressionsThe Annals of Mathematical Statistics, 1963
- Statistical Methods in Chemical AnalysesNature, 1947