Divergence Optimization for Noisy Universal Domain Adaptation
Authors:
- 1 June 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2515-2524
Abstract
Universal domain adaptation (UniDA) has been proposed to transfer knowledge learned from a label-rich source domain to a label-scarce target domain without any constraints on the label sets. In practice, however, it is difficult to obtain a large amount of perfectly clean labeled data in a source domain with limited resources. Existing UniDA methods rely on source samples with correct annotations, which greatly limits their application in the real world. Hence, we consider a new realistic setting called Noisy UniDA, in which classifiers are trained with noisy labeled data from the source domain and unlabeled data with an unknown class distribution from the target domain. This paper introduces a two-head convolutional neural network framework to solve all problems simultaneously. Our network consists of one common feature generator and two classifiers with different decision boundaries. By optimizing the divergence between the two classifiers’ outputs, we can detect noisy source samples, find "unknown" classes in the target domain, and align the distribution of the source and target domains. In an extensive evaluation of different domain adaptation settings, the proposed method outperformed existing methods by a large margin in most settings.Keywords
All Related Versions
This publication has 23 references indexed in Scilit:
- Making Deep Neural Networks Robust to Label Noise: A Loss Correction Approach2017
- Deep Hashing Network for Unsupervised Domain Adaptation2017
- Adversarial Discriminative Domain Adaptation2017
- Deep Reconstruction-Classification Networks for Unsupervised Domain Adaptation2016
- Deep Residual Learning for Image Recognition2016
- Towards Open Set Deep Networks2016
- YFCC100MCommunications of the ACM, 2016
- Adapting Visual Category Models to New Domains2010
- A theory of learning from different domainsMachine Learning, 2009
- Combining labeled and unlabeled data with co-training1998