Increasing the Effectiveness of Active Learning: Introducing Artificial Data Generation in Active Learning for Land Use/Land Cover Classification
Open Access
- 4 July 2021
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 13 (13) , 2619
Abstract
In remote sensing, Active Learning (AL) has become an important technique to collect informative ground truth data “on-demand” for supervised classification tasks. Despite its effectiveness, it is still significantly reliant on user interaction, which makes it both expensive and time consuming to implement. Most of the current literature focuses on the optimization of AL by modifying the selection criteria and the classifiers used. Although improvements in these areas will result in more effective data collection, the use of artificial data sources to reduce human–computer interaction remains unexplored. In this paper, we introduce a new component to the typical AL framework, the data generator, a source of artificial data to reduce the amount of user-labeled data required in AL. The implementation of the proposed AL framework is done using Geometric SMOTE as the data generator. We compare the new AL framework to the original one using similar acquisition functions and classifiers over three AL-specific performance metrics in seven benchmark datasets. We show that this modification of the AL framework significantly reduces cost and time requirements for a successful AL implementation in all of the datasets used in the experiment.Keywords
Funding Information
- Fundação para a Ciência e a Tecnologia (PCIF/SSI/0102/2017 - foRESTER, DSAIPA/AI/0100/2018 - IPSTERS)
This publication has 56 references indexed in Scilit:
- Facing Imbalanced Data--Recommendations for the Use of Performance Metrics2013
- Let us know your decision: Pool-based active training of a generative classifier with the selection strategy 4DSInformation Sciences, 2013
- Analysing the classification of imbalanced data-sets with multiple classes: Binarization techniques and ad-hoc approachesKnowledge-Based Systems, 2013
- Making better use of accuracy data in land change studies: Estimating accuracy and area and quantifying uncertainty using stratified estimationRemote Sensing of Environment, 2013
- Using active learning to adapt remote sensing image classifiersRemote Sensing of Environment, 2011
- Death to Kappa: birth of quantity disagreement and allocation disagreement for accuracy assessmentInternational Journal of Remote Sensing, 2011
- Active learning for class imbalance problem2007
- EditorialACM SIGKDD Explorations Newsletter, 2004
- Generalized Linear ModelsJournal of the Royal Statistical Society. Series A (General), 1972
- Individual Comparisons by Ranking MethodsBiometrics Bulletin, 1945