A Lightweight 1-D Convolution Augmented Transformer with Metric Learning for Hyperspectral Image Classification
Open Access
Abstract
Hyperspectral image (HSI) classification is the subject of intense research in remote sensing. The tremendous success of deep learning in computer vision has recently sparked the interest in applying deep learning in hyperspectral image classification. However, most deep learning methods for hyperspectral image classification are based on convolutional neural networks (CNN). Those methods require heavy GPU memory resources and run time. Recently, another deep learning model, the transformer, has been applied for image recognition, and the study result demonstrates the great potential of the transformer network for computer vision tasks. In this paper, we propose a model for hyperspectral image classification based on the transformer, which is widely used in natural language processing. Besides, we believe we are the first to combine the metric learning and the transformer model in hyperspectral image classification. Moreover, to improve the model classification performance when the available training samples are limited, we use the 1-D convolution and Mish activation function. The experimental results on three widely used hyperspectral image data sets demonstrate the proposed model’s advantages in accuracy, GPU memory cost, and running time.Keywords
Funding Information
- National Key Research and Development Program of China (No.2017YFB1301104 and 2017YFB1001900)
- National Natural Science Foundation of China (No.91648204 and 61803375)
This publication has 24 references indexed in Scilit:
- A semi-supervised convolutional neural network for hyperspectral image classificationRemote Sensing Letters, 2017
- A Sparse and Low-Rank Near-Isometric Linear Embedding Method for Feature Extraction in Hyperspectral Imagery ClassificationIEEE Transactions on Geoscience and Remote Sensing, 2017
- A Discriminative Feature Learning Approach for Deep Face Recognition2016
- Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural NetworksIEEE Transactions on Geoscience and Remote Sensing, 2016
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Spectral–Spatial Classification of Hyperspectral Image Based on Deep Auto-EncoderIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2016
- Hyperspectral Imagery Classification Using Sparse Representations of Convolutional Neural Network FeaturesRemote Sensing, 2016
- Spectral–Spatial Classification of Hyperspectral Data Based on Deep Belief NetworkIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2015
- Sea water chlorophyll-a estimation using hyperspectral images and supervised Artificial Neural NetworkEcological Informatics, 2014
- Deep Learning-Based Classification of Hyperspectral DataIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2014