Learning Deep Hierarchical Visual Feature Coding
Authors:
- 11 March 2014
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 25 (12) , 2212-2225
Abstract
In this paper, we propose a hybrid architecture that combines the image modeling strengths of the bag of words framework with the representational power and adaptability of learning deep architectures. Local gradient-based descriptors, such as SIFT, are encoded via a hierarchical coding scheme composed of spatial aggregating restricted Boltzmann machines (RBM). For each coding layer, we regularize the RBM by encouraging representations to fit both sparse and selective distributions. Supervised fine-tuning is used to enhance the quality of the visual representation for the categorization task. We performed a thorough experimental evaluation using three image categorization data sets. The hierarchical coding scheme achieved competitive categorization accuracies of 79.7% and 86.4% on the Caltech-101 and 15-Scenes data sets, respectively. The visual representations learned are compact and the model's inference is fast, as compared with sparse coding methods. The low-level representations of descriptors that were learned using this method result in generic features that we empirically found to be transferrable between different image data sets. Further analysis reveal the significance of supervised fine-tuning when the architecture has two layers of representations as opposed to a single layer.Keywords
Funding Information
- French Embassy in Singapore through the Merlion Project and Ph.D. Program
This publication has 51 references indexed in Scilit:
- Learning Deep Architectures for AIFoundations and Trends in Machine Learning, 2009
- Reducing the Dimensionality of Data with Neural NetworksScience, 2006
- A Fast Learning Algorithm for Deep Belief NetsNeural Computation, 2006
- Training Products of Experts by Minimizing Contrastive DivergenceNeural Computation, 2002
- Characterizing the sparseness of neural codesNetwork: Computation in Neural Systems, 2001
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- Emergence of simple-cell receptive field properties by learning a sparse code for natural imagesNature, 1996
- The relative advantages of sparse versus distributed encoding for associative neuronal networks in the brainNetwork: Computation in Neural Systems, 1990
- Learning representations by back-propagating errorsNature, 1986
- Conditional Expectation and Unbiased Sequential EstimationThe Annals of Mathematical Statistics, 1947