WilcoxCV: an R package for fast variable selection in cross-validation
Open Access
- 11 May 2007
- journal article
- research article
- Published by Oxford University Press (OUP) in Bioinformatics
- Vol. 23 (13) , 1702-1704
Abstract
Summary: In the last few years, numerous methods have been proposed for microarray-based class prediction. Although many of them have been designed especially for the case n ≪ p (much more variables than observations), preliminary variable selection is almost always necessary when the number of genes reaches several tens of thousands, as usual in recent data sets. In the two-class setting, the Wilcoxon rank sum test statistic is, with the t-statistic, one of the standard approaches for variable selection. It is well known that the variable selection step must be seen as a part of classifier construction and, as such, be performed based on training data only. When classifier accuracy is evaluated via cross-validation or Monte–Carlo cross-validation, it means that we have to perform p Wilcoxon or t-tests for each iteration, which becomes a daunting task for increasing p. As a consequence, many authors often perform variable selection only once using all the available data, which can induce a dramatic underestimation of error rate and thus lead to misleadingly reporting predictive power. We propose a very fast implementation of variable selection based on the Wilcoxon test for use in cross-validation and Monte Carlo cross-validation (also known as random splitting into learning and test sets). This implementation is based on a simple mathematical formula using only the ranks calculated from the original data set. Availability: Our method is implemented in the freely available R package WilcoxCV which can be downloaded from the Comprehensive R Archive Network at http://cran.r-project.org/src/contrib/Descriptions/WilcoxCV.html Contact:boulesteix@slcmsr.orgKeywords
This publication has 12 references indexed in Scilit:
- Partial least squares: a versatile tool for the analysis of high-dimensional genomic dataBriefings in Bioinformatics, 2006
- Identification of interaction patterns and classification with applications to microarray dataComputational Statistics & Data Analysis, 2006
- Dimension Reduction for Classification with Gene Expression Microarray DataStatistical Applications in Genetics and Molecular Biology, 2006
- An extensive comparison of recent classification tools applied to microarray dataComputational Statistics & Data Analysis, 2005
- Microarrays and molecular research: noise discovery?The Lancet, 2005
- Microarrays and molecular research: noise discovery?The Lancet, 2005
- A comprehensive evaluation of multicategory classification methods for microarray gene expression cancer diagnosisBioinformatics, 2004
- Classification of gene microarrays by penalized logistic regressionBiostatistics, 2004
- Is cross-validation valid for small-sample microarray classification?Bioinformatics, 2004
- Selection bias in gene extraction on the basis of microarray gene-expression dataProceedings of the National Academy of Sciences, 2002