CleanNet: Transfer Learning for Scalable Image Classifier Training with Label Noise
Authors:
- Kuang-Huei LeeKLKuang-Huei Lee
- Xiaodong HeXHXiaodong He
- Lei ZhangLZLei Zhang
- Linjun YangLYLinjun Yang
Top Cited Papers
- 1 June 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 5447-5456
Abstract
In this paper, we study the problem of learning image classification models with label noise. Existing approaches depending on human supervision are generally not scalable as manually identifying correct or incorrect labels is time-consuming, whereas approaches not relying on human supervision are scalable but less effective. To reduce the amount of human supervision for label noise cleaning, we introduce CleanNet, a joint neural embedding network, which only requires a fraction of the classes being manually verified to provide the knowledge of label noise that can be transferred to other classes. We further integrate CleanNet and conventional convolutional neural network classifier into one framework for image classification learning. We demonstrate the effectiveness of the proposed algorithm on both of the label noise detection task and the image classification on noisy data task on several large-scale datasets. Experimental results show that CleanNet can reduce label noise detection error rate on held-out classes where no human supervision available by 41.5% compared to current weakly supervised methods. It also achieves 47% of the performance gain of verifying all images with only 3.2% images verified on an image classification task. Source code and dataset will be available at kuanghuei.github.io/CleanNetProject.Keywords
All Related Versions
This publication has 21 references indexed in Scilit:
- Hierarchical Attention Networks for Document Classification2016
- Webly Supervised Learning of Convolutional Networks2015
- Learning Discriminative Reconstructions for Unsupervised Outlier Removal2015
- Classification in the Presence of Label Noise: A SurveyIEEE Transactions on Neural Networks and Learning Systems, 2013
- Fast, Accurate Detection of 100,000 Object Classes on a Single Machine2013
- Harvesting Image Databases from the WebIEEE Transactions on Pattern Analysis and Machine Intelligence, 2010
- A study of the effect of different types of noise on the precision of supervised learning techniquesArtificial Intelligence Review, 2010
- Reducing the Dimensionality of Data with Neural NetworksScience, 2006
- Estimating the Support of a High-Dimensional DistributionNeural Computation, 2001
- WordNetCommunications of the ACM, 1995