Remote Sensing Image Scene Classification Based on Global Self-Attention Module
Open Access
- 12 November 2021
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 13 (22) , 4542
Abstract
The complexity of scene images makes the research on remote-sensing image scene classification challenging. With the wide application of deep learning in recent years, many remote-sensing scene classification methods using a convolutional neural network (CNN) have emerged. Current CNN usually output global information by integrating the depth features extricated from the convolutional layer through the fully connected layer; however, the global information extracted is not comprehensive. This paper proposes an improved remote-sensing image scene classification method based on a global self-attention module to address this problem. The global information is derived from the depth characteristics extracted by the CNN. In order to better express the semantic information of the remote-sensing image, the multi-head self-attention module is introduced for global information augmentation. Meanwhile, the local perception unit is utilized to improve the self-attention module’s representation capabilities for local objects. The proposed method’s effectiveness is validated through comparative experiments with various training ratios and different scales on public datasets (UC Merced, AID, and NWPU-NESISC45). The precision of our proposed model is significantly improved compared to other methods for remote-sensing image scene classification.Keywords
Funding Information
- the Strategic Priority Program of Chinese Academy of Science (XDA19090200)
- Capacity Building Project of Big Earth Science Data Center of Chinese Academy of Science (WX145XQ07-13)
This publication has 57 references indexed in Scilit:
- Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer LearningIEEE Transactions on Medical Imaging, 2016
- Transferring Deep Convolutional Neural Networks for the Scene Classification of High-Resolution Remote Sensing ImageryRemote Sensing, 2015
- Deep Learning Based Feature Selection for Remote Sensing Scene ClassificationIEEE Geoscience and Remote Sensing Letters, 2015
- Multimodal Classification of Remote Sensing Images: A Review and Future DirectionsProceedings of the IEEE, 2015
- Going deeper with convolutions2015
- Multispectral Image Alignment With Nonlinear Scale-Invariant Keypoint and Enhanced Local Feature MatrixIEEE Geoscience and Remote Sensing Letters, 2015
- Multi-class geospatial object detection and geographic image classification based on collection of part detectorsISPRS Journal of Photogrammetry and Remote Sensing, 2014
- Land-Use Scene Classification Using a Concentric Circle-Structured Multiscale Bag-of-Visual-Words ModelIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2014
- Histograms of Oriented Gradients for Human Detection2005
- Multiresolution gray-scale and rotation invariant texture classification with local binary patternsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002