A Supervised Feature Selection Method For Mixed-Type Data using Density-based Feature Clustering
Preprint
Abstract
Feature selection methods are widely used to address the high computational overheads and curse of dimensionality in classifying high-dimensional data. Most conventional feature selection methods focus on handling homogeneous features, while real-world datasets usually have a mixture of continuous and discrete features. Some recent mixed-type feature selection studies only select features with high relevance to class labels and ignore the redundancy among features. The determination of an appropriate feature subset is also a challenge. In this paper, a supervised feature selection method using density-based feature clustering (SFSDFC) is proposed to obtain an appropriate final feature subset for mixed-type data. SFSDFC decomposes the feature space into a set of disjoint feature clusters using a novel density-based clustering method. Then, an effective feature selection strategy is employed to obtain a subset of important features with minimal redundancy from those feature clusters. Extensive experiments as well as comparison studies with five state-of-the-art methods are conducted on SFSDFC using thirteen real-world benchmark datasets and results justify the efficacy of the SFSDFC method.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- Rough set model based feature selection for mixed-type data with feature space decompositionExpert Systems with Applications, 2018
- Co-regularized unsupervised feature selectionNeurocomputing, 2018
- Subspace clustering guided unsupervised feature selectionPattern Recognition, 2017
- Feature selection in mixed data: A method using a novel fuzzy rough set-based information entropyPattern Recognition, 2016
- An efficient feature selection algorithm for hybrid dataNeurocomputing, 2016
- Determining the number of clusters using information entropy for mixed dataPattern Recognition, 2012
- Geometrical codification for clustering mixed categorical and numerical databasesJournal of Intelligent Information Systems, 2011
- Measuring relevance between discrete and continuous features based on neighborhood mutual informationExpert Systems with Applications, 2011
- Neighborhood rough set based heterogeneous feature subset selectionInformation Sciences, 2008
- Feature selection algorithm for mixed data with both nominal and continuous featuresPattern Recognition Letters, 2007