Adapting Object Detectors with Conditional Domain Normalization
Authors:
Preprint
Abstract
Real-world object detectors are often challenged by the domain gaps between different datasets. In this work, we present the Conditional Domain Normalization (CDN) to bridge the domain gap. CDN is designed to encode different domain inputs into a shared latent space, where the features from different domains carry the same domain attribute. To achieve this, we first disentangle the domain-specific attribute out of the semantic features from one domain via a domain embedding module, which learns a domain-vector to characterize the corresponding domain attribute information. Then this domain-vector is used to encode the features from another domain through a conditional normalization, resulting in different domains' features carrying the same domain attribute. We incorporate CDN into various convolution stages of an object detector to adaptively address the domain shifts of different level's representation. In contrast to existing adaptation works that conduct domain confusion learning on semantic features to remove domain-specific factors, CDN aligns different domain distributions by modulating the semantic features of one domain conditioned on the learned domain-vector of another domain. Extensive experiments show that CDN outperforms existing methods remarkably on both real-to-real and synthetic-to-real adaptation benchmarks, including 2D image detection and 3D point cloud detection.Keywords
All Related Versions
This publication has 7 references indexed in Scilit:
- Domain Adaptation for Structured Output via Discriminative Patch Representations2019
- Semantic Image Synthesis With Spatially-Adaptive Normalization2019
- Recovering Realistic Texture in Image Super-Resolution by Deep Spatial Feature Transform2018
- Semantic Foggy Scene Understanding with Synthetic DataInternational Journal of Computer Vision, 2018
- Driving in the Matrix: Can virtual worlds replace human-generated annotations for real world tasks?2017
- The Cityscapes Dataset for Semantic Urban Scene Understanding2016
- A theory of learning from different domainsMachine Learning, 2009