A Multipath and Multiscale Siamese Network Based on Spatial-Spectral Features for Few-Shot Hyperspectral Image Classification
Open Access
- 6 September 2023
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 15 (18) , 4391
Abstract
Deep learning has been demonstrated to be a powerful nonlinear modeling method with end-to-end optimization capabilities for hyperspectral Images (HSIs). However, in real classification cases, obtaining labeled samples is often time-consuming and labor-intensive, resulting in few-shot training samples. Based on this issue, a multipath and multiscale Siamese network based on spatial-spectral features for few-shot hyperspectral image classification (MMSN) is proposed. To conduct classification with few-shot training samples, a Siamese network framework with low dependence on sample information is adopted. In one subnetwork, a spatial attention module (DCAM), which combines dilated convolution and cosine similarity to comprehensively consider spatial-spectral weights, is designed first. Then, we propose a residual-dense hybrid module (RDHM), which merges three-path features, including grouped convolution-based local residual features, global residual features and global dense features. The RDHM can effectively propagate and utilize different layers of features and enhance the expression ability of these features. Finally, we construct a multikernel depth feature extraction module (MDFE) that performs multiscale convolutions with multikernel and hierarchical skip connections on the feature scales to improve the ability of the network to capture details. Extensive experimental evidence shows that the proposed MMSN method exhibits a superior performance on few-shot training samples, and its classification results are better than those of other state-of-the-art classification methods.Keywords
Funding Information
- National Natural Science Foundation of China (62001434, 62071084)
This publication has 28 references indexed in Scilit:
- A Sparse and Low-Rank Near-Isometric Linear Embedding Method for Feature Extraction in Hyperspectral Imagery ClassificationIEEE Transactions on Geoscience and Remote Sensing, 2017
- A deep learning framework for hyperspectral image classification using spatial pyramid poolingRemote Sensing Letters, 2016
- Deep Residual Learning for Image Recognition2016
- Hyperspectral Imagery Classification Using Sparse Representations of Convolutional Neural Network FeaturesRemote Sensing, 2016
- Spectral–spatial classification of hyperspectral images using deep convolutional neural networksRemote Sensing Letters, 2015
- Global and Local Real-Time Anomaly Detectors for Hyperspectral Remote Sensing ImageryRemote Sensing, 2015
- Deep Convolutional Neural Networks for Hyperspectral Image ClassificationJournal of Sensors, 2015
- Sea water chlorophyll-a estimation using hyperspectral images and supervised Artificial Neural NetworkEcological Informatics, 2014
- Improved Capability in Stone Pine Forest Mapping and Management in Lebanon Using Hyperspectral CHRIS-Proba Data Relative to Landsat ETM+Photogrammetric Engineering & Remote Sensing, 2014
- Status of land cover classification accuracy assessmentRemote Sensing of Environment, 2002