AIFS-DATASET for Few-Shot Aerial Image Scene Classification
- 7 February 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 60 (01962892) , 1-11
Abstract
Few-shot learning (FSL), which aims to rapidly recognize unseen categories with limited samples, has attracted wide attention in aerial image scene classification. However, the existing methods generally train and evaluate the model within a dataset, and changing the dataset requires retraining and evaluation, which only realizes the generalization of intra-dataset. Considering meta-learning, this brings in a natural assumption: FSL should learn meta-knowledge from cross-domain heterogeneous tasks and then can generalize to new data distributions (e.g., datasets) with few samples. To this end, we propose a new benchmark, dubbed aerial image few-shot dataset (AIFS-DATASET), which is composed of diverse datasets and can provide more realistic heterogeneous task distributions. On AIFS-DATASET, we use many heterogeneous tasks, across multi-domains without any aerial image category, to train the model, achieving “see more.” Then we transfer the learned knowledge to new tasks in aerial images to evaluate the generalization performance of the model, thus acquiring a “well-informed” few-shot aerial image scene classification model. Moreover, the challenges of inter-class similarity and intra-class discrepancy in aerial images still exist. We also develop a dual constrained distance metric learning (DC-DML) framework to deal with the variable learning tasks adaptively and to achieve compact data distribution within a class and clear distribution gaps between classes from the perspective of metric learning. DC-DML mainly uses a task-adapted feature extractor while devising a novel distance metric with a cross-class bias penalty. By conducting experiments on AIFS-DATASET, we observed that DC-DML outperforms the current prevailing FSL approaches by a large margin.Keywords
Funding Information
- National Science Foundation of China (62071388, 62136007, 62036005, U20B2068)
- Innovation Foundation for Doctor Dissertation of Northwestern Polytechnical University (CX2021022)
- Key Research and Development Program of Shaanxi Province (2021ZDLGY01-08)
This publication has 45 references indexed in Scilit:
- Remote Sensing Image Scene Classification Using Bag of Convolutional FeaturesIEEE Geoscience and Remote Sensing Letters, 2017
- Densely Connected Convolutional Networks2017
- Remote Sensing Scene Classification by Unsupervised Representation LearningIEEE Transactions on Geoscience and Remote Sensing, 2017
- AID: A Benchmark Data Set for Performance Evaluation of Aerial Scene ClassificationIEEE Transactions on Geoscience and Remote Sensing, 2017
- Remote Sensing Image Scene Classification: Benchmark and State of the ArtProceedings of the IEEE, 2017
- Towards better exploiting convolutional neural networks for remote sensing scene classificationPattern Recognition, 2017
- Describing Textures in the Wild2014
- Detection of traffic signs in real-world images: The German traffic sign detection benchmark2013
- High-resolution satellite scene classification using a sparse coding based multiple feature combinationInternational Journal of Remote Sensing, 2011
- Bag-of-visual-words and spatial extensions for land-use classification2010