Robust Few-Shot Learning for User-Provided Data
- 20 April 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 32 (4) , 1433-1447
Abstract
Few-shot learning (FSL) focuses on distilling transferrable knowledge from existing experience to cope with novel concepts for which the labeled data are scarce. A typical assumption in FSL is that the training examples of novel classes are all clean with no outlier interference. In many realistic applications where examples are provided by users, however, data are potentially noisy or unreadable. In this context, we introduce a novel research topic, robust FSL (RFSL), where we aim to address two types of outliers within user-provided data: the representation outlier (RO) and the label outlier (LO). Moreover, we introduce a metric for estimating robustness and use it to investigate the performance of several advanced methods to FSL when faced with user-provided outliers. In addition, we propose robust attentive profile networks (RapNets) to achieve outlier suppression. The results of a comprehensive evaluation of benchmark data sets demonstrate the shortcomings of current FSL methods and the superiority of the proposed RapNets when dealing with RFSL problems, establishing a benchmark for follow-up studies.Keywords
Funding Information
- National Natural Science Foundation of China (61876095, 61751308)
- Beijing Natural Science Foundatio
- Beijing Academy of Artificial Intelligence
This publication has 40 references indexed in Scilit:
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Classification in the Presence of Label Noise: A SurveyIEEE Transactions on Neural Networks and Learning Systems, 2013
- A Review of Image Denoising Algorithms, with a New OneMultiscale Modeling & Simulation, 2005
- A Survey of Outlier Detection MethodologiesArtificial Intelligence Review, 2004
- MDL denoisingIEEE Transactions on Information Theory, 2000
- Robust Ensemble Learning for Data Mining2000
- A Fast Algorithm for the Minimum Covariance Determinant EstimatorTechnometrics, 1999
- Long Short-Term MemoryNeural Computation, 1997
- Bimodal distribution removal1993
- Performance of Some Resistant Rules for Outlier LabelingJournal of the American Statistical Association, 1986