Hyperspectral Image Classification with IFormer Network Feature Extraction
Open Access
- 29 September 2022
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 14 (19) , 4866
Abstract
Convolutional neural networks (CNNs) are widely used for hyperspectral image (HSI) classification due to their better ability to model the local details of HSI. However, CNNs tends to ignore the global information of HSI, and thus lack the ability to establish remote dependencies, which leads to computational cost consumption and remains challenging. To address this problem, we propose an end-to-end Inception Transformer network (IFormer) that can efficiently generate rich feature maps from HSI data and extract high- and low-frequency information from the feature maps. First, spectral features are extracted using batch normalization (BN) and 1D-CNN, while the Ghost Module generates more feature maps via low-cost operations to fully exploit the intrinsic information in HSI features, thus improving the computational speed. Second, the feature maps are transferred to Inception Transformer through a channel splitting mechanism, which effectively learns the combined features of high- and low-frequency information in the feature maps and allows for the flexible modeling of discriminative information scattered in different frequency ranges. Finally, the HSI features are classified via pooling and linear layers. The IFormer algorithm is compared with other mainstream algorithms in experiments on four publicly available hyperspectral datasets, and the results demonstrate that the proposed method algorithm is significantly competitive among the HSI classification algorithms.Keywords
Funding Information
- National Natural Science Foundation of China (61971200, 61977022, 2020JJ2017, 2019SK2012, XSKJ2021000-12, XSKJ2021000-13, 2021JJ40226, 21B0590, 21B0595, 20B062)
- Science Foundation for Distinguished Young Scholars of Hunan Province (61971200, 61977022, 2020JJ2017, 2019SK2012, XSKJ2021000-12, XSKJ2021000-13, 2021JJ40226, 21B0590, 21B0595, 20B062)
- Key Research and Development Program of Hunan Province (61971200, 61977022, 2020JJ2017, 2019SK2012, XSKJ2021000-12, XSKJ2021000-13, 2021JJ40226, 21B0590, 21B0595, 20B062)
- Foundation of Department of Water Resources of Hunan Province (61971200, 61977022, 2020JJ2017, 2019SK2012, XSKJ2021000-12, XSKJ2021000-13, 2021JJ40226, 21B0590, 21B0595, 20B062)
- Natural Science Foundation of Hunan Province (61971200, 61977022, 2020JJ2017, 2019SK2012, XSKJ2021000-12, XSKJ2021000-13, 2021JJ40226, 21B0590, 21B0595, 20B062)
- Foundation of Education Bureau of Hunan Province (61971200, 61977022, 2020JJ2017, 2019SK2012, XSKJ2021000-12, XSKJ2021000-13, 2021JJ40226, 21B0590, 21B0595, 20B062)
This publication has 54 references indexed in Scilit:
- Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning ApproachIEEE Transactions on Geoscience and Remote Sensing, 2016
- Hyperspectral Image Target Detection Improvement Based on Total VariationIEEE Transactions on Image Processing, 2016
- Generation of Spectral–Temporal Response Surfaces by Combining Multispectral Satellite and Hyperspectral UAV Imagery for Precision Agriculture ApplicationsIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2015
- Spectral–Spatial Classification of Hyperspectral Data Based on Deep Belief NetworkIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2015
- Deep Convolutional Neural Networks for Hyperspectral Image ClassificationJournal of Sensors, 2015
- Deep Learning-Based Classification of Hyperspectral DataIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2014
- The neural bases of spatial frequency processing during scene perceptionFrontiers in Integrative Neuroscience, 2014
- LIBSVMACM Transactions on Intelligent Systems and Technology, 2011
- Spectral and Spatial Classification of Hyperspectral Data Using SVMs and Morphological ProfilesIEEE Transactions on Geoscience and Remote Sensing, 2008
- Classification of hyperspectral remote sensing images with support vector machinesIEEE Transactions on Geoscience and Remote Sensing, 2004