Incorporating prior probabilities into high-dimensional classifiers
Open Access
- 16 February 2010
- journal article
- research article
- Published by Oxford University Press (OUP) in Biometrika
- Vol. 97 (1) , 31-48
Abstract
In standard parametric classifiers, or classifiers based on nonparametric methods but where there is an opportunity for estimating population densities, the prior probabilities of the respective populations play a key role. However, those probabilities are largely ignored in the construction of high-dimensional classifiers, partly because there are no likelihoods to be constructed or Bayes risks to be estimated. Nevertheless, including information about prior probabilities can reduce the overall error rate, particularly in cases where doing so is most important, i.e. when the classification problem is particularly challenging and error rates are not close to zero. In this paper we suggest a general approach to reducing error rate in this way, by using a method derived from Breiman’s bagging idea. The potential improvements in performance are identified in theoretical and numerical work, the latter involving both applications to real data and simulations. The method is simple and explicit to apply, and does not involve choice of any tuning parameters.Keywords
This publication has 20 references indexed in Scilit:
- Scale adjustments for classifiers in high-dimensional, low sample size settingsBiometrika, 2009
- High-dimensional classification using features annealed independence rulesThe Annals of Statistics, 2008
- An improved centroid classifier for text categorizationExpert Systems with Applications, 2008
- Distance-Weighted DiscriminationJournal of the American Statistical Association, 2007
- Classification of microarrays to nearest centroidsBioinformatics, 2005
- Geometric Representation of High Dimension, Low Sample Size DataJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- Systematic benchmarking of microarray data classification: assessing the role of non-linearity and dimensionality reductionBioinformatics, 2004
- On Differential Variability of Expression Ratios: Improving Statistical Inference about Gene Expression Changes from Microarray DataJournal of Computational Biology, 2001
- Classification by pairwise couplingThe Annals of Statistics, 1998
- RANK ANALYSIS OF INCOMPLETE BLOCK DESIGNSBiometrika, 1952