Unveiling the potential of diffusion model-based framework with transformer for hyperspectral image classification
Open Access
- 10 April 2024
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 14 (1) , 1-11
Abstract
Hyperspectral imaging has gained popularity for analysing remotely sensed images in various fields such as agriculture and medical. However, existing models face challenges in dealing with the complex relationships and characteristics of spectral–spatial data due to the multi-band nature and data redundancy of hyperspectral data. To address this limitation, we propose a novel approach called DiffSpectralNet, which combines diffusion and transformer techniques. The diffusion method is able extract diverse and meaningful spectral–spatial features, leading to improvement in HSI classification. Our approach involves training an unsupervised learning framework based on the diffusion model to extract high-level and low-level spectral–spatial features, followed by the extraction of intermediate hierarchical features from different timestamps for classification using a pre-trained denoising U-Net. Finally, we employ a supervised transformer-based classifier to perform the HSI classification. We conduct comprehensive experiments on three publicly available datasets to validate our approach. The results demonstrate that our framework significantly outperforms existing approaches, achieving state-of-the-art performance. The stability and reliability of our approach are demonstrated across various classes in all datasets.Keywords
This publication has 40 references indexed in Scilit:
- Analyzing Bias in Diffusion-based Face Generation Models2023
- Hyperspectral Image Classification—Traditional to Deep Models: A Survey for Future ProspectsIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2021
- Deep learning classifiers for hyperspectral imaging: A reviewISPRS Journal of Photogrammetry and Remote Sensing, 2019
- Deep Learning for Classification of Hyperspectral Data: A Comparative ReviewIEEE Geoscience and Remote Sensing Magazine, 2019
- Deep Residual Learning for Image Recognition2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Deep learningNature, 2015
- Spectral-spatial classification of hyperspectral image using autoencoders2013
- Advances in Spectral-Spatial Classification of Hyperspectral ImagesProceedings of the IEEE, 2012
- Neural Network Approaches Versus Statistical Methods In Classification Of Multisource Remote Sensing DataIEEE Transactions on Geoscience and Remote Sensing, 1990