SRL‐ProtoNet: Self‐supervised representation learning for few‐shot remote sensing scene classification
Authors:
Open Access
- 2 September 2024
- journal article
- research article
- Published by Institution of Engineering and Technology (IET) in IET Computer Vision
- Vol. 18 (7) , 1034-1042
Abstract
Using a deep learning method to classify a large amount of labelled remote sensing scene data produces good performance. However, it is challenging for deep learning based methods to generalise to classification tasks with limited data. Few‐shot learning allows neural networks to classify unseen categories when confronted with a handful of labelled data. Currently, episodic tasks based on meta‐learning can effectively complete few‐shot classification, and training an encoder that can conduct representation learning has become an important component of few‐shot learning. An end‐to‐end few‐shot remote sensing scene classification model based on ProtoNet and self‐supervised learning is proposed. The authors design the Pre‐prototype for a more discrete feature space and better integration with self‐supervised learning, and also propose the ProtoMixer for higher quality prototypes with a global receptive field. The authors’ method outperforms the existing state‐of‐the‐art self‐supervised based methods on three widely used benchmark datasets: UC‐Merced, NWPU‐RESISC45, and AID. Compare with previous state‐of‐the‐art performance. For the one‐shot setting, this method improves by 1.21%, 2.36%, and 0.84% in AID, UC‐Merced, and NWPU‐RESISC45, respectively. For the five‐shot setting, this method surpasses by 0.85%, 2.79%, and 0.74% in the AID, UC‐Merced, and NWPU‐RESISC45, respectively.Keywords
Funding Information
- Natural Science Foundation of Jilin Province (20190302026GX, 20200201037JC)
This publication has 13 references indexed in Scilit:
- MITformer: A Multiinstance Vision Transformer for Remote Sensing Scene ClassificationIEEE Geoscience and Remote Sensing Letters, 2022
- Vision Transformer: An Excellent Teacher for Guiding Small Networks in Remote Sensing Image Scene ClassificationIEEE Transactions on Geoscience and Remote Sensing, 2022
- Swin Transformer: Hierarchical Vision Transformer using Shifted Windows2021
- RS-MetaNet: Deep Metametric Learning for Few-Shot Remote Sensing Scene ClassificationIEEE Transactions on Geoscience and Remote Sensing, 2020
- Momentum Contrast for Unsupervised Visual Representation Learning2020
- Lifelong Learning for Scene Recognition in Remote Sensing ImagesIEEE Geoscience and Remote Sensing Letters, 2019
- Deep Few-Shot Learning for Hyperspectral Image ClassificationIEEE Transactions on Geoscience and Remote Sensing, 2018
- Learning to Compare: Relation Network for Few-Shot Learning2018
- Lunar Crater Detection Based on Terrain Analysis and Mathematical Morphology Methods Using Digital Elevation ModelsIEEE Transactions on Geoscience and Remote Sensing, 2018
- Remote Sensing Image Scene Classification: Benchmark and State of the ArtProceedings of the IEEE, 2017