A noise-based stability evaluation of threshold-based feature selection techniques
Authors:
- 1 August 2011
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 240-245
Abstract
This paper presents a noise-based stability performance evaluation approach for feature selection techniques. For the stability assessment, a similarity-based measure is used to quantify the degree of agreement between a filter's output on a clean dataset and its outputs on the same dataset corrupted with different combinations of noise level and noise distribution. Experiments are conducted with 11 threshold-based feature selection techniques on six different real-world datasets. The experimental results show that some filters perform much better than others in terms of their insensitivity to noise. The results also show an interesting relationship between the size of the training data and the stability performance of a filter; the stability performance of a filter tends to improve when learning from large size datasets.Keywords
This publication has 10 references indexed in Scilit:
- Comparative Analysis of DNA Microarray Data through the Use of Feature Selection Techniques2010
- Knowledge discovery from imbalanced and noisy dataData & Knowledge Engineering, 2009
- Robust biomarker identification for cancer diagnosis with ensemble feature selection methodsBioinformatics, 2009
- A Study on the Relationships of Classifier Performance Metrics2009
- Accurate molecular classification of cancer using simple rulesBMC Medical Genomics, 2009
- Consensus group stable feature selection2009
- Improving Stability of Feature Selection Methods2007
- Stability of feature selection algorithms: a study on high-dimensional spacesKnowledge and Information Systems, 2006
- A Comparative Performance Study of Feature Selection Methods for the Anti-spam Filtering Domain2006
- Using mutual information for selecting features in supervised neural net learningIEEE Transactions on Neural Networks, 1994