HybridSN: Exploring 3-D–2-D CNN Feature Hierarchy for Hyperspectral Image Classification
Top Cited Papers
- 12 June 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 17 (2) , 277-281
Abstract
Hyperspectral image (HSI) classification is widely used for the analysis of remotely sensed images. Hyperspectral imagery includes varying bands of images. Convolutional neural network (CNN) is one of the most frequently used deep learning-based methods for visual data processing. The use of CNN for HSI classification is also visible in recent works. These approaches are mostly based on 2-D CNN. On the other hand, the HSI classification performance is highly dependent on both spatial and spectral information. Very few methods have used the 3-D-CNN because of increased computational complexity. This letter proposes a hybrid spectral CNN (HybridSN) for HSI classification. In general, the HybridSN is a spectral-spatial 3-D-CNN followed by spatial 2-D-CNN. The 3-D-CNN facilitates the joint spatial-spectral feature representation from a stack of spectral bands. The 2-D-CNN on top of the 3-D-CNN further learns more abstract-level spatial representation. Moreover, the use of hybrid CNNs reduces the complexity of the model compared to the use of 3-D-CNN alone. To test the performance of this hybrid approach, very rigorous HSI classification experiments are performed over Indian Pines, University of Pavia, and Salinas Scene remote sensing data sets. The results are compared with the state-of-the-art hand-crafted as well as end-to-end deep learning-based methods. A very satisfactory performance is obtained using the proposed HybridSN for HSI classification. The source code can be found at https://github.com/gokriznastic/HybridSN.Keywords
All Related Versions
Funding Information
- IIIT SRi City, India
This publication has 30 references indexed in Scilit:
- Unsupervised Spectral–Spatial Feature Learning via Deep Residual Conv–Deconv Network for Hyperspectral Image ClassificationIEEE Transactions on Geoscience and Remote Sensing, 2017
- Spectral–Spatial Residual Network for Hyperspectral Image Classification: A 3-D Deep Learning FrameworkIEEE Transactions on Geoscience and Remote Sensing, 2017
- Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural NetworksIEEE Transactions on Geoscience and Remote Sensing, 2016
- Deep Residual Learning for Image Recognition2016
- Deep supervised learning for hyperspectral data classification through convolutional neural networks2015
- Multiple Feature Learning for Hyperspectral Image ClassificationIEEE Transactions on Geoscience and Remote Sensing, 2014
- Advances in Hyperspectral Image Classification: Earth Monitoring with Statistical Learning MethodsIEEE Signal Processing Magazine, 2013
- 3D Convolutional Neural Networks for Human Action RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- Composite Kernels for Hyperspectral Image ClassificationIEEE Geoscience and Remote Sensing Letters, 2006
- Classification of hyperspectral remote sensing images with support vector machinesIEEE Transactions on Geoscience and Remote Sensing, 2004