MS3CHFormer: A Multi-Scale Spatial–Spectral Convolutional Hybrid Transformer for Hyperspectral Image Classification
Open Access
- 3 July 2026
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 18 (13) , 2173
Abstract
Deep learning methods that integrate convolutional neural networks (CNNs) and Transformers have achieved remarkable progress in hyperspectral image (HSI) classification. However, existing methods still suffer from insufficient multi-scale spatial–spectral feature modeling, a lack of efficient interaction mechanisms between local and global features, and the inherent high computational complexity and redundant information of Transformers, which limit model performance. To address these issues, a Multi-Scale Spatial–Spectral Convolutional Hybrid Transformer model (MS3CHFormer) is proposed in this article. Specifically, a Multi-Scale Spatial–Spectral Convolution Module (MS3ConvM) is first constructed. Through a multi-branch and multi-receptive-field design, it jointly models spatial and spectral features at different scales, thereby enhancing the representation capability of complex ground objects. Then, a Token-Selective Sparse Transformer Encoder (TSSTE) is designed, which adaptively selects tokens and performs sparse modeling via a Dynamic Correlation-Aware Attention (DCAA) mechanism, effectively reducing computational complexity while suppressing redundant information and further reinforcing key feature representations. Furthermore, a Local–Global Feature Fusion Module (LGFFM) is designed to achieve deep complementary fusion of CNN and Transformer features by mapping them into different representation spaces. Finally, a Detail-Preserving Enhancement Module (DPEM) introduces original detail information through residual connections to compensate for detail loss in high-level semantic representations, thereby enhancing the representation capability of boundaries and fine-grained structures. Experiments and comparative analyses on four public HSI datasets demonstrate that the proposed MS3CHFormer outperforms state-of-the-art methods and achieves superior classification accuracy under limited training samples, exhibiting excellent robustness and generalization ability.Keywords
Funding Information
- Department of Science and Technology of Jilin Province (YDZJ202501ZYTS528)
This publication has 38 references indexed in Scilit:
- Deep learning for hyperspectral image classification: A comprehensive review and future predictionsInformation Fusion, 2025
- A review of hyperspectral image classification based on graph neural networksArtificial Intelligence Review, 2025
- Deep learning for hyperspectral image classification: A surveyComputer Science Review, 2024
- A systematic review of hyperspectral imaging in precision agriculture: Analysis of its current state and future prospectsComputers and Electronics in Agriculture, 2024
- SemanticFormer: Hyperspectral image classification via semantic transformerPattern Recognition Letters, 2024
- Double-branch feature fusion transformer for hyperspectral image classificationScientific Reports, 2023
- WHU-Hi: UAV-borne hyperspectral with high spatial resolution (H2) benchmark datasets and classifier for precise crop identification based on deep convolutional neural network with CRFRemote Sensing of Environment, 2020
- Three-dimensional convolutional neural network model for tree species classification using airborne hyperspectral imagesRemote Sensing of Environment, 2020
- 3D CNN with Localized Residual Connections for Hyperspectral Image Classification2020
- Convolutional neural network for spectral–spatial classification of hyperspectral imagesNeural Computing and Applications, 2019