A Novel Two-Stage Spectrum-Based Approach for Dimensionality Reduction: A Case Study on the Recognition of Handwritten Numerals
Open Access
- 12 May 2014
- journal article
- research article
- Published by Wiley in Journal of Applied Mathematics
- Vol. 2014, 1-14
Abstract
Dimensionality reduction (feature selection) is an important step in pattern recognition systems. Although there are different conventional approaches for feature selection, such as Principal Component Analysis, Random Projection, and Linear Discriminant Analysis, selecting optimal, effective, and robust features is usually a difficult task. In this paper, a new two-stage approach for dimensionality reduction is proposed. This method is based on one-dimensional and two-dimensional spectrum diagrams of standard deviation and minimum to maximum distributions for initial feature vector elements. The proposed algorithm is validated in an OCR application, by using two big standard benchmark handwritten OCR datasets, MNIST and Hoda. In the beginning, a 133-element feature vector was selected from the most used features, proposed in the literature. Finally, the size of initial feature vector was reduced from 100% to 59.40% (79 elements) for the MNIST dataset, and to 43.61% (58 elements) for the Hoda dataset, in order. Meanwhile, the accuracies of OCR systems are enhanced 2.95% for the MNIST dataset, and 4.71% for the Hoda dataset. The achieved results show an improvement in the precision of the system in comparison to the rival approaches, Principal Component Analysis and Random Projection. The proposed technique can also be useful for generating decision rules in a pattern recognition system using rule-based classifiers.Keywords
This publication has 21 references indexed in Scilit:
- A comparative study of dimensionality reduction techniques to enhance trace clustering performancesExpert Systems with Applications, 2013
- Clustering biological data with SOMs: On topology preservation in non-linear dimensional reductionExpert Systems with Applications, 2013
- Improving Offline Handwritten Digit Recognition Using Concavity-Based FeaturesInternational Journal of Computers Communications & Control, 2013
- Comparing the dimensionality reduction methods in gene expression databasesExpert Systems with Applications, 2012
- Feature reduction and selection for EMG signal classificationExpert Systems with Applications, 2012
- Offline OCR System for Machine-Printed Turkish Using Template MatchingAdvanced Materials Research, 2011
- Dimensionality reduction techniques for blog visualizationExpert Systems with Applications, 2011
- Multiclass Classification of Unconstrained Handwritten Arabic Words Using Machine Learning ApproachesThe Open Signal Processing Journal, 2009
- Use of Multi-category Proximal SVM for Data Set Reduction2004
- A numeral character recognition using the PCA mixture modelPattern Recognition Letters, 2002