Multi-Label Learning from Single Positive Labels
Preprint
Abstract
Predicting all applicable labels for a given image is known as multi-label classification. Compared to the standard multi-class case (where each image has only one label), it is considerably more challenging to annotate training data for multi-label classification. When the number of potential labels is large, human annotators find it difficult to mention all applicable labels for each training image. Furthermore, in some settings detection is intrinsically difficult e.g. finding small object instances in high resolution images. As a result, multi-label training data is often plagued by false negatives. We consider the hardest version of this problem, where annotators provide only one relevant label for each image. As a result, training sets will have only one positive label per image and no confirmed negatives. We explore this special case of learning from missing labels across four different multi-label image classification datasets for both linear classifiers and end-to-end fine-tuned deep networks. We extend existing multi-label losses to this setting and propose novel variants that constrain the number of expected positive labels during training. Surprisingly, we show that in some cases it is possible to approach the performance of fully labeled classifiers despite training with significantly fewer confirmed labels.Keywords
All Related Versions
This publication has 33 references indexed in Scilit:
- Multi-label Learning from Noisy Labels with Non-linear Feature Transformation2019
- Learning Multi Labels from Single Label —— An Extreme Weak Label Learning AlgorithmWuhan University Journal of Natural Sciences, 2019
- Exploring the Limits of Weakly Supervised Pretraining2018
- Deep Generative Models for Weakly-Supervised Multi-Label Classification2018
- Learning Visual Features from Large Weakly Supervised Data2016
- Dynamic label propagation for semi-supervised multi-class multi-label classificationPattern Recognition, 2016
- The Pascal Visual Object Classes Challenge: A RetrospectiveInternational Journal of Computer Vision, 2014
- Microsoft COCO: Common Objects in Context2014
- Semi-supervised Multi-label ClassificationLecture Notes in Computer Science, 2012
- ML-KNN: A lazy learning approach to multi-label learningPattern Recognition, 2007