Source-Free Multidomain Adaptation With Fuzzy Rule-Based Deep Neural Networks
- 17 May 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Fuzzy Systems
- Vol. 31 (12) , 4180-4194
Abstract
Unsupervised domain adaptation deals with a task from an unlabeled target domain by leveraging the knowledge gained from labeled source domain(s). Fuzzy system is adopted in domain adaptation to better tackle the uncertainty caused by information scarcity in the transfer. Most existing fuzzy and non-fuzzy domain adaptation methods depend on data-level distribution matching to eliminate domain shift. However, data sharing can trigger privacy concerns. This situation results in the unavailability of source data, wherein most domain adaptation methods cannot be applied. Source-free domain adaptation is then proposed to handle this problem. But existing source-free domain adaptation methods rarely deal with any soft information component due to data imprecision. Besides, fewer methods handle multiple source domains which provide richer transfer information. Thus, in this paper, we propose source-free multi-domain adaptation with fuzzy rule-based deep neural networks (SF-FDN), which takes advantage of a fuzzy system to handle data uncertainty in domain adaptation without source data. To learn source private models with high generality, which is important to collect low noisy pseudo target labels, auxiliary tasks are designed by jointly training source models from multiple domains which share source parameters and fuzzy rules while protecting source data. To transfer fuzzy rules and fit source private parameters to the target domain, self-supervised learning and anchor-based alignment are built to force target data to source feature spaces. Experiments on real-world datasets under both homogeneous and heterogeneous label space scenarios are carried out to validate the proposed method. The results indicate the superiority of the proposed fuzzy rule-based source-free multi-domain adaptation method.Keywords
Funding Information
- Australian Research Council (FL190100149)
This publication has 47 references indexed in Scilit:
- Fuzzy Multiple-Source Transfer LearningIEEE Transactions on Fuzzy Systems, 2019
- Separate to Adapt: Open Set Domain Adaptation via Progressive Separation2019
- Open Set Domain Adaptation by Backpropagation2018
- Residual Parameter Transfer for Deep Domain Adaptation2018
- Partial Transfer Learning with Selective Adversarial Networks2018
- Learning to Adapt Structured Output Space for Semantic Segmentation2018
- Transfer learning using computational intelligence: A surveyKnowledge-Based Systems, 2015
- A Survey on Transfer LearningIEEE Transactions on Knowledge and Data Engineering, 2009
- Deep transfer via second-order Markov logic2009
- An overview of statistical learning theoryIEEE Transactions on Neural Networks, 1999