Self-Adversarial Disentangling for Specific Domain Adaptation
- 23 January 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. PP (01628828) , 1-14
Abstract
Domain adaptation aims to bridge the domain shifts between the source and the target domain. These shifts may span different dimensions such as fog, rainfall, etc. However, recent methods typically do not consider explicit prior knowledge about the domain shifts on a specific dimension, thus leading to less desired adaptation performance. In this paper, we study a practical setting called Specific Domain Adaptation (SDA) that aligns the source and target domains in a demanded-specific dimension. Within this setting, we observe the intra-domain gap induced by different domainness ( i.e., numerical magnitudes of domain shifts in this dimension) is crucial when adapting to a specific domain. To address the problem, we propose a novel Self-Adversarial Disentangling (SAD) framework. In particular, given a specific dimension, we first enrich the source domain by introducing a domainness creator with providing additional supervisory signals. Guided by the created domainness, we design a self-adversarial regularizer and two loss functions to jointly disentangle the latent representations into domainness-specific and domainness-invariant features, thus mitigating the intra-domain gap. Our method can be easily taken as a plug-and-play framework and does not introduce any extra costs in the inference time. We achieve consistent improvements over state-of-the-art methods in both object detection and semantic segmentation.Keywords
All Related Versions
Funding Information
- National Key Research and Development Program of China (2019YFC1521104)
- National Natural Science Foundation of China (72192821, 61972157)
- Shanghai Municipal Science and Technology Major Project (2021SHZDZX0102)
- Shanghai Science and Technology Commission (21511101200)
- Shanghai Sailing Program (22YF1420300)
This publication has 79 references indexed in Scilit:
- DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Optimal Transport for Domain AdaptationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Scatter Component Analysis: A Unified Framework for Domain Adaptation and Domain GeneralizationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Deep Residual Learning for Image Recognition2016
- The Cityscapes Dataset for Semantic Urban Scene Understanding2016
- Fully convolutional networks for semantic segmentation2015
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014
- Vision meets robotics: The KITTI datasetThe International Journal of Robotics Research, 2013