Neural-Response-Based Extreme Learning Machine for Image Classification
- 3 July 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 30 (2) , 539-552
Abstract
This paper proposes a novel and simple multilayer feature learning method for image classification by employing the extreme learning machine (ELM). The proposed algorithm is composed of two stages: the multilayer ELM (ML-ELM) feature mapping stage and the ELM learning stage. The ML-ELM feature mapping stage is recursively built by alternating between feature map construction and maximum pooling operation. In particular, the input weights for constructing feature maps are randomly generated and hence need not be trained or tuned, which makes the algorithm highly efficient. Moreover, the maximum pooling operation enables the algorithm to be invariant to certain transformations. During the ELM learning stage, elastic-net regularization is proposed to learn the output weight. Elastic-net regularization helps to learn more compact and meaningful output weight. In addition, we preprocess the input data with the dense scale-invariant feature transform operation to improve both the robustness and invariance of the algorithm. To evaluate the effectiveness of the proposed method, several experiments are conducted on three challenging databases. Compared with the conventional deep learning methods and other related ones, the proposed method achieves the best classification results with high computational efficiency.Keywords
Funding Information
- National Natural Science Foundation of China (61472155, 91330118, 61075116)
- China Scholarship Council (201406160081)
This publication has 38 references indexed in Scilit:
- The Sparseness of Mixed Selectivity Neurons Controls the Generalization–Discrimination Trade-OffThe Journal of Neuroscience, 2013
- Similarity learning for object recognition based on derived kernelNeurocomputing, 2012
- Mathematics of the Neural ResponseFoundations of Computational Mathematics, 2009
- Enhanced random search based incremental extreme learning machineNeurocomputing, 2008
- Convex incremental extreme learning machineNeurocomputing, 2007
- A Fast Learning Algorithm for Deep Belief NetsNeural Computation, 2006
- Regularization and Variable Selection Via the Elastic NetJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- Face recognition: a convolutional neural-network approachIEEE Transactions on Neural Networks, 1997
- Generalized Inverses, Ridge Regression, Biased Linear Estimation, and Nonlinear EstimationTechnometrics, 1970