Scale adjustments for classifiers in high-dimensional, low sample size settings
Authors:
- Yao-Ban ChanYCYao-Ban Chan
- Peter HallPHPeter Hall
- 1 April 2009
- journal article
- Published by Oxford University Press (OUP) in Biometrika
- Vol. 96 (2) , 469-478
Abstract
Distance-based classifiers are generally considered to be effective at discriminating between populations that differ in location. Indeed, nearest-neighbour methods and the support vector machine are frequently used in very high-dimensional problems involving gene expression data, where it is believed that elevated levels of expression convey much of the information for classification. However, one problem inherent to distance-based classifiers is that scale differences can mask location differences. In consequence, such classifiers can have poor performance if the information for classification accumulates through a large number of relatively small location differences in data components, rather than via large differences. In this paper, we show that a simple adjustment for scale, applicable to a variety of distance-based classifiers, can remedy the problem. For some classifiers, such as those based on the support vector machine or the centroid method, scale corrections are important primarily in the case of small training-sample sizes. However, for other classifiers, including those based on nearest-neighbour and average-distance methods, scale adjustments are helpful more generally.Keywords
This publication has 10 references indexed in Scilit:
- Distance-Weighted DiscriminationJournal of the American Statistical Association, 2007
- The use of active shape models for locating structures in medical images2005
- Geometric Representation of High Dimension, Low Sample Size DataJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- Study of Complexation in Methanol/Water Mixtures by Infrared and Raman Spectroscopy and Multivariate Curve Resolution—Alternating Least-Squares AnalysisApplied Spectroscopy, 2003
- Comparison of Discrimination Methods for the Classification of Tumors Using Gene Expression DataJournal of the American Statistical Association, 2002
- Affine-invariant recognition of gray-scale characters using global affine transformation correlationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001
- Support vector machine classification and validation of cancer tissue samples using microarray expression dataBioinformatics, 2000
- A gene expression database for the molecular pharmacology of cancerNature Genetics, 2000
- Systematic variation in gene expression patterns in human cancer cell linesNature Genetics, 2000
- A Tutorial on Support Vector Machines for Pattern RecognitionData Mining and Knowledge Discovery, 1998