Meta-learning based on parameter transfer for few-shot classification of remote sensing scenes
Authors:
- 26 March 2021
- journal article
- research article
- Published by Taylor & Francis in Remote Sensing Letters
- Vol. 12 (6) , 531-541
Abstract
Meta-learning is an effective way to deal with the few-shot problem that only very few annotated data samples are available for training the model. In remote sensing scene classification, previous methods with meta-learning often apply a shallow neural network due to lacking sufficient annotated training data that can support the larger number of parameters of a deep neural network (DNN). However, it is a common phenomenon that a DNN can bring more improvement than a shallow neural network. To this end, we propose a meta-learning method based on parameter transfer. Specifically, we firstly apply parameter transfer to fix the parameters in a DNN to relax the problem of training the large number of parameters. In detail, two variants of parameter transfer are designed to adapt to two different conditions about available annotated data samples, including applying supervised learning for normal meta-training and applying unsupervised domain adaptation for even less meta-training data. Then, the model uses a simple trimming operation to make a minor overhaul on the fixed parameters, which avoids updating the large number of parameters but obtains significant improvement. We perform experiments on three common datasets to demonstrate the improved accuracies and advantages of the feature extraction capability of our method.Keywords
Funding Information
- National Natural Science Foundation of China
- Aeronautical Science Foundation of China
This publication has 16 references indexed in Scilit:
- High-Rankness Regularized Semi-Supervised Deep Metric Learning for Remote Sensing ImageryRemote Sensing, 2020
- Meta Metric Learning for Highly Imbalanced Aerial Scene Classification2020
- Deep Relation Network for Hyperspectral Image Few-Shot ClassificationRemote Sensing, 2020
- Few Shot Scene Classification in Remote Sensing using Meta-Agnostic Machine2020
- Dimensionality Reduction of Hyperspectral Imagery Based on Spatial–Spectral Manifold LearningIEEE Transactions on Cybernetics, 2019
- Semisupervised Scene Classification for Remote Sensing Images: A Method Based on Convolutional Neural Networks and Ensemble LearningIEEE Geoscience and Remote Sensing Letters, 2019
- Deep Few-Shot Learning for Hyperspectral Image ClassificationIEEE Transactions on Geoscience and Remote Sensing, 2018
- SuperPCA: A Superpixelwise PCA Approach for Unsupervised Feature Extraction of Hyperspectral ImageryIEEE Transactions on Geoscience and Remote Sensing, 2018
- Remote Sensing Image Scene Classification: Benchmark and State of the ArtProceedings of the IEEE, 2017
- Integrating structured biological data by Kernel Maximum Mean DiscrepancyBioinformatics, 2006