An outlier map for Support Vector Machine classification
Author:
- Michiel DebruyneMDMichiel Debruyne
Open Access
- 1 December 2009
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Applied Statistics
- Vol. 3 (4) , 1566-1580
Abstract
Support Vector Machines are a widely used classification technique. They are computationally efficient and provide excellent predictions even for high-dimensional data. Moreover, Support Vector Machines are very flexible due to the incorporation of kernel functions. The latter allow to model nonlinearity, but also to deal with nonnumerical data such as protein strings. However, Support Vector Machines can suffer a lot from unclean data containing, for example, outliers or mislabeled observations. Although several outlier detection schemes have been proposed in the literature, the selection of outliers versus nonoutliers is often rather ad hoc and does not provide much insight in the data. In robust multivariate statistics outlier maps are quite popular tools to assess the quality of data under consideration. They provide a visual representation of the data depicting several types of outliers. This paper proposes an outlier map designed for Support Vector Machine classification. The Stahel–Donoho outlyingness measure from multivariate statistics is extended to an arbitrary kernel space. A trimmed version of Support Vector Machines is defined trimming part of the samples with largest outlyingness. Based on this classifier, an outlier map is constructed visualizing data in any type of high-dimensional kernel space. The outlier map is illustrated on 4 biological examples showing its use in exploratory data analysis.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- Reflection implies the SCHFundamenta Mathematicae, 2008
- Detecting potential labeling errors in microarrays by data perturbationBioinformatics, 2006
- Taxonomic utility of a phylogenetic analysis of phosphoglycerate kinase proteins of Archaea, Bacteria, and Eukaryota: Insights by Bayesian analysesMolecular Phylogenetics and Evolution, 2005
- Systematic benchmarking of microarray data classification: assessing the role of non-linearity and dimensionality reductionBioinformatics, 2004
- Gene expression profile of adult T-cell acute lymphocytic leukemia identifies distinct subsets of patients with different response to therapy and survivalBlood, 2004
- Robust PCA and classification in biosciencesBioinformatics, 2004
- Protein homology detection using string alignment kernelsBioinformatics, 2004
- Detecting outlying samples in microarray data: A critical assessment of the effect of outliers on sample classificationChem-Bio Informatics Journal, 2003
- The Behavior of the Stahel-Donoho Robust Multivariate EstimatorJournal of the American Statistical Association, 1995
- Unmasking Multivariate Outliers and Leverage PointsJournal of the American Statistical Association, 1990