Neighborhood Component Feature Selection for High-Dimensional Data
Authors:
- Wei YangWYWei Yang
- Kuanquan WangKWKuanquan Wang
- Wangmeng ZuoWZWangmeng Zuo
Top Cited Papers
- 1 January 2012
- journal article
- Published by International Academy Publishing (IAP) in Journal of Computers
- Vol. 7 (1) , 161-168
Abstract
Feature selection is of considerable importance in data mining and machine learning, especially for high dimensional data. In this paper, we propose a novel nearest neighbor-based feature weighting algorithm, which learns a feature weighting vector by maximizing the expected leave-one-out classification accuracy with a regularization term. The algorithm makes no parametric assumptions about the distribution of the data and scales naturally to multiclass problems. Experiments conducted on artificial and real data sets demonstrate that the proposed algorithm is largely insensitive to the increase in the number of irrelevant features and performs better than the state-of-the-art methods in most casesKeywords
This publication has 10 references indexed in Scilit:
- Simultaneous feature selection and classification using kernel-penalized support vector machinesInformation Sciences, 2011
- Feature selection based on loss-margin of nearest neighbor classificationPattern Recognition, 2009
- Large Margin Feature Weighting Method via Linear ProgrammingIEEE Transactions on Knowledge and Data Engineering, 2008
- A review of feature selection techniques in bioinformaticsBioinformatics, 2007
- Iterative RELIEF for Feature Weighting: Algorithms, Theories, and ApplicationsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Feature Extraction2006
- A comprehensive evaluation of multicategory classification methods for microarray gene expression cancer diagnosisBioinformatics, 2004
- Choosing Multiple Parameters for Support Vector MachinesMachine Learning, 2002
- Distinct types of diffuse large B-cell lymphoma identified by gene expression profilingNature, 2000
- Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arraysProceedings of the National Academy of Sciences, 1999