A Robust Supervised Variable Selection for Noisy High-Dimensional Data
Open Access
- 2 June 2015
- journal article
- research article
- Published by Wiley in BioMed Research International
- Vol. 2015, 1-10
Abstract
The Minimum Redundancy Maximum Relevance (MRMR) approach to supervised variable selection represents a successful methodology for dimensionality reduction, which is suitable for high-dimensional data observed in two or more different groups. Various available versions of the MRMR approach have been designed to search for variables with the largest relevance for a classification task while controlling for redundancy of the selected set of variables. However, usual relevance and redundancy criteria have the disadvantages of being too sensitive to the presence of outlying measurements and/or being inefficient. We propose a novel approach called Minimum Regularized Redundancy Maximum Robust Relevance (MRRMRR), suitable for noisy high-dimensional data observed in two groups. It combines principles of regularization and robust statistics. Particularly, redundancy is measured by a new regularized version of the coefficient of multiple correlation and relevance is measured by a highly robust correlation coefficient based on the least weighted squares regression with data-adaptive weights. We compare various dimensionality reduction methods on three real data sets. To investigate the influence of noise or outliers on the data, we perform the computations also for data artificially contaminated by severe noise of various forms. The experimental results confirm the robustness of the method with respect to outliers.Keywords
Funding Information
- Grantová Agentura České Republiky (GA13-17187S)
This publication has 28 references indexed in Scilit:
- Review of robust multivariate statistical methods in high dimensionAnalytica Chimica Acta, 2011
- Metabolomic profiles delineate potential role for sarcosine in prostate cancer progressionNature, 2009
- Classification with High‐Dimensional Genetic Data: Assigning Patients and Genetic Features to Known ClassesBiometrical Journal, 2008
- High-Breakdown Robust Multivariate MethodsStatistical Science, 2008
- Regularized linear discriminant analysis and its application in microarraysBiostatistics, 2006
- Dimension Reduction for Classification with Gene Expression Microarray DataStatistical Applications in Genetics and Molecular Biology, 2006
- A Shrinkage Approach to Large-Scale Covariance Matrix Estimation and Implications for Functional GenomicsStatistical Applications in Genetics and Molecular Biology, 2005
- Class Prediction by Nearest Shrunken Centroids, with Applications to DNA MicroarraysStatistical Science, 2003
- Using mutual information for selecting features in supervised neural net learningIEEE Transactions on Neural Networks, 1994
- Least median of weighted squares in logistic regression with large strataBiometrika, 1994