SPFormer: Self-Pooling Transformer for Few-Shot Hyperspectral Image Classification

Authors:
Publisher website
Google Scholar
Abstract
Transformer has shown great potential in extracting global features and it can achieve better classification performance with large number of training samples compared with other deep learning (DL) models. However, most of the existing Transformer-based models for hyperspectral image (HSI) classification simply use the multi-head self-attention and channel multilayer perceptron (MLP) modules, which contain many parameters to learn, resulting in poor performance in few-shot learning scenario. To overcome the above issue, a lightweight self-pooling Transformer (SPFormer) is proposed for few-shot HSI classification. First, a one-layer autoencoder based on self-supervised learning is built to reduce the dimensionality of HSI. Second, two parameter-free modules, channel shuffle for multi-head self-pooing with sparse mapping (CSSM-MHSP) and central token mixer (CTM), are proposed for mapping spectral features to higher dimensions and promoting information interaction between pixels, respectively. Third, a light-weight channel embedding is designed to extract deep spectral features. Finally, a fully connected layer is used for classification. The classification performance of the proposed method is evaluated on four benchmark datasets, showing its superiority in classification accuracy, generalization performance and model complexity compared to existing state-of-the-art methods with limited training samples.
Funding Information
  • National Natural Science Foundation of China (41971279, 42201406, 42271324)
  • Natural Science Foundation of the Jiangsu Higher Education Institutions of China (22KJD420001)
  • Natural Science Foundation of Jiangsu Province (BK20221506)

This publication has 60 references indexed in Scilit: