A Style and Semantic Memory Mechanism for Domain Generalization
Authors:
- 1 October 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 9144-9153
Abstract
Mainstream state-of-the-art domain generalization algorithms tend to prioritize the assumption on semantic in-variance across domains. Meanwhile, the inherent intra-domain style invariance is usually underappreciated and put on the shelf. In this paper, we reveal that leveraging intra-domain style invariance is also of pivotal importance in improving the efficiency of domain generalization. We verify that it is critical for the network to be informative on what domain features are invariant and shared among in-stances, so that the network sharpens its understanding and improves its semantic discriminative ability. Correspondingly, we also propose a novel “jury” mechanism, which is particularly effective in learning useful semantic feature commonalities among domains. Our complete model called STEAM can be interpreted as a novel probabilistic graphical model, for which the implementation requires convenient constructions of two kinds of memory banks: semantic feature bank and style feature bank. Empirical results show that our proposed framework surpasses the state-of-the-art methods by clear margins.Keywords
All Related Versions
Funding Information
- Fundamental Research Funds for the Central Universities
This publication has 29 references indexed in Scilit:
- Deep Domain Generalization via Conditional Invariant Adversarial Networks2018
- Domain Generalization with Adversarial Feature Learning2018
- Maximum Classifier Discrepancy for Unsupervised Domain Adaptation2018
- Unified Deep Supervised Domain Adaptation and Generalization2017
- Deeper, Broader and Artier Domain Generalization2017
- Unsupervised Pixel-Level Domain Adaptation with Generative Adversarial Networks2017
- Deep Hashing Network for Unsupervised Domain Adaptation2017
- Deep Residual Learning for Image Recognition2016
- Semi-supervised Domain Adaptation with Subspace Learning for visual recognition2015
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998