Re-energizing Domain Discriminator with Sample Relabeling for Adversarial Domain Adaptation
Authors:
- 1 October 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 9154-9163
Abstract
Many unsupervised domain adaptation (UDA) methods exploit domain adversarial training to align the features to reduce domain gap, where a feature extractor is trained to fool a domain discriminator in order to have aligned feature distributions. The discrimination capability of the domain classifier w.r.t. the increasingly aligned feature distributions deteriorates as training goes on, thus cannot effectively further drive the training of feature extractor. In this work, we propose an efficient optimization strategy named Re-enforceable Adversarial Domain Adaptation (RADA) which aims to re-energize the domain discriminator during the training by using dynamic domain labels. Particularly, we relabel the well aligned target domain samples as source domain samples on the fly. Such relabeling makes the less separable distributions more separable, and thus leads to a more powerful domain classifier w.r.t. the new data distributions, which in turn further drives feature alignment. Extensive experiments on multiple UDA benchmarks demonstrate the effectiveness and superiority of our RADA.Keywords
All Related Versions
Funding Information
- Research and Development
This publication has 36 references indexed in Scilit:
- Unsupervised Domain Adaptation with Similarity Learning2018
- Associative Domain Adaptation2017
- Mind the Class Weight Bias: Weighted Maximum Mean Discrepancy for Unsupervised Domain Adaptation2017
- Deep Hashing Network for Unsupervised Domain Adaptation2017
- Adversarial Discriminative Domain Adaptation2017
- Subspace Interpolation via Dictionary Learning for Unsupervised Domain Adaptation2013
- Stochastic Gradient Descent Tricks2012
- Integrating structured biological data by Kernel Maximum Mean DiscrepancyBioinformatics, 2006
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- A database for handwritten text recognition researchIEEE Transactions on Pattern Analysis and Machine Intelligence, 1994