Domain Adaptation by Joint Distribution Invariant Projections

Authors:
Publisher website
Google Scholar
Abstract
Domain adaptation addresses the learning problem where the training data are sampled from a source joint distribution (source domain), while the test data are sampled from a different target joint distribution (target domain). Because of this joint distribution mismatch, a discriminative classifier naively trained on the source domain often generalizes poorly to the target domain. In this article, we therefore present a Joint Distribution Invariant Projections (JDIP) approach to solve this problem. The proposed approach exploits linear projections to directly match the source and target joint distributions under the L 2 -distance. Since the traditional kernel density estimators for distribution estimation tend to be less reliable as the dimensionality increases, we propose a least square method to estimate the L 2 -distance without the need to estimate the two joint distributions, leading to a quadratic problem with analytic solution. Furthermore, we introduce a kernel version of JDIP to account for inherent nonlinearity in the data. We show that the proposed learning problems can be naturally cast as optimization problems defined on the product of Riemannian manifolds. To be comprehensive, we also establish an error bound, theoretically explaining how our method works and contributes to reducing the target domain generalization error. Extensive empirical evidence demonstrates the benefits of our approach over state-of-the-art domain adaptation methods on several visual data sets.
Funding Information
  • National Natural Science Foundation of China (61906069)
  • Guangdong Basic and Applied Basic Research Foundation (2019A1515011411, 2019A1515011700)
  • Project Funded by the China Postdoctoral Science Foundation (2019M662912)
  • Science and Technology Program of Guangzhou (202002030355)
  • Fundamental Research Funds for the Central Universities (2019MS088)

This publication has 44 references indexed in Scilit: