Distance-based features in pattern classification
Authors:
Open Access
- 18 September 2011
- journal article
- Published by Springer Nature in EURASIP Journal on Advances in Signal Processing
- Vol. 2011 (1) , 1
Abstract
In data mining and pattern classification, feature extraction and representation methods are a very important step since the extracted features have a direct and significant impact on the classification accuracy. In literature, numbers of novel feature extraction and representation methods have been proposed. However, many of them only focus on specific domain problems. In this article, we introduce a novel distance-based feature extraction method for various pattern classification problems. Specifically, two distances are extracted, which are based on (1) the distance between the data and its intra-cluster center and (2) the distance between the data and its extra-cluster centers. Experiments based on ten datasets containing different numbers of classes, samples, and dimensions are examined. The experimental results using naïve Bayes, k-NN, and SVM classifiers show that concatenating the original features provided by the datasets to the distance-based features can improve classification accuracy except image-related datasets. In particular, the distance-based features are suitable for the datasets which have smaller numbers of classes, numbers of samples, and the lower dimensionality of features. Moreover, two datasets, which have similar characteristics, are further used to validate this finding. The result is consistent with the first experiment result that adding the distance-based features can improve the classification performance.Keywords
This publication has 18 references indexed in Scilit:
- A triangle area based nearest neighbors approach to intrusion detectionPattern Recognition, 2010
- Hybrid genetic algorithms and support vector machines for bankruptcy predictionExpert Systems with Applications, 2006
- Essential classification rule setsACM Transactions on Database Systems, 2004
- Bayesian shape model for facial feature extraction and recognitionPattern Recognition, 2003
- Feature extraction based on the Bhattacharyya distancePattern Recognition, 2003
- Statistical pattern recognition: a reviewIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Feature subset selection using a genetic algorithmIEEE Intelligent Systems and their Applications, 1998
- Selection of relevant features and examples in machine learningArtificial Intelligence, 1997
- Analysis of a complex of statistical variables into principal components.Journal of Educational Psychology, 1933
- LIII. On lines and planes of closest fit to systems of points in spaceJournal of Computers in Education, 1901