Automatic Identification of Local Features Representing Image Content with the Use of Convolutional Neural Networks
Open Access
- 28 July 2020
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 10 (15) , 5186
Abstract
Image analysis has many practical applications and proper representation of image content is its crucial element. In this work, a novel type of representation is proposed where an image is reduced to a set of highly sparse matrices. Equivalently, it can be viewed as a set of local features of different types, as precise coordinates of detected keypoints are given. Additionally, every keypoint has a value expressing feature intensity at a given location. These features are extracted from a dedicated convolutional neural network autoencoder. This kind of representation has many advantages. First of all, local features are not manually designed but are automatically trained for a given class of images. Second, as they are trained in a network that restores its input on the output, they may be expected to minimize information loss. Consequently, they can be used to solve similar tasks replacing original images; such an ability was illustrated with image classification task. Third, the generated features, although automatically synthesized, are relatively easy to interpret. Taking a decoder part of our network, one can easily generate a visual building block connected with a specific feature. As the proposed method is entirely new, a detailed analysis of its properties for a relatively simple data set was conducted and is described in this work. Moreover, to present the quality of trained features, it is compared with results of convolutional neural networks having a similar working principle (sparse coding).Keywords
Funding Information
- Narodowe Centrum Nauki (2012/05/D/ST6/03091)
This publication has 32 references indexed in Scilit:
- Sparse Convolutional Neural Networks2015
- Spiking Deep Convolutional Neural Networks for Energy-Efficient Object RecognitionInternational Journal of Computer Vision, 2014
- Caffe2014
- Sparse Representation Based Fisher Discrimination Dictionary Learning for Image ClassificationInternational Journal of Computer Vision, 2014
- A Max-Margin Perspective on Sparse Representation-Based Classification2013
- LSD: a Line Segment DetectorImage Processing On Line, 2012
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009
- Speeded-Up Robust Features (SURF)Computer Vision and Image Understanding, 2008
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Role of Temporal Integration and Fluctuation Detection in the Highly Irregular Firing of a Leaky Integrator Neuron Model with Partial ResetNeural Computation, 1997