Unseen Feature Extraction: Spatial Mapping Expansion With Spectral Compression Network for Hyperspectral Image Classification
- 27 June 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 62 (01962892) , 1-15
Abstract
Hyperspectral image classification (HSIC) models have made remarkable progress in the last decade. Nevertheless, the downsized mapping in the convolutional neural network (CNN) and down-sampled mechanism in the transformer-based approach amplify the loss of hidden knowledge in the subpixel that encompasses crucial yet unseen features within a single pixel. Considering this aspect, the mentioned popular solutions for HSIC contradict the inherent characteristic of hyperspectral data. To address this issue, we rethink the size factor in CNN and propose a novel spatial mapping expansion with spectral compression network (SMESC) for HSIC. Specifically, the SMESC builds a mapping expansion network to mine unseen information in subpixels with enlarged feature maps. A channel modulation residual block is developed to compress spectral redundancy and promote salient channels with modulation information. Moreover, we design a multiple-size training strategy to substitute the traditional multiple FE branches and improve the model adaptation to the different sizes of the testing samples. The extensive experimental results and analysis of four hyperspectral image datasets demonstrate the superiority of the proposed architecture compared to other advanced HSIC methods. Our code will be released at https://github.com/ Chirsycy/SMESC.Keywords
Funding Information
- National Natural Science Foundation of China (61971082, 42271355, 42101350)
- Science Foundation of Liaoning Province through the Surface Project (LJKZ0065)
This publication has 44 references indexed in Scilit:
- From degrade to upgrade: Learning a self-supervised degradation guided adaptive network for blind remote sensing image super-resolutionInformation Fusion, 2023
- MSLAENet: Multiscale Learning and Attention Enhancement Network for Fusion Classification of Hyperspectral and LiDAR DataIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2022
- Multiscale Densely Connected Attention Network for Hyperspectral Image ClassificationIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2022
- Hyperspectral Image Classification Using a Hybrid 3D-2D Convolutional Neural NetworksIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2021
- A Simplified 2D-3D CNN Architecture for Hyperspectral Image Classification Based on Spatial–Spectral FusionIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2020
- Hyperspectral Image Classification Method Based on CNN Architecture Embedding With Hashing Semantic FeatureIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2019
- Spectral–Spatial Graph Convolutional Networks for Semisupervised Hyperspectral Image ClassificationIEEE Geoscience and Remote Sensing Letters, 2018
- Classification of Hyperspectral Imagery Using a New Fully Convolutional Neural NetworkIEEE Geoscience and Remote Sensing Letters, 2018
- Hyperspectral image reconstruction by deep convolutional neural network for classificationPattern Recognition, 2017
- Generalized Graph-Based Fusion of Hyperspectral and LiDAR Data Using Morphological FeaturesIEEE Geoscience and Remote Sensing Letters, 2014