Domain Adaptation via Transfer Component Analysis
Top Cited Papers
- 18 November 2010
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 22 (2) , 199-210
Abstract
Domain adaptation allows knowledge from a source domain to be transferred to a different but related target domain. Intuitively, discovering a good feature representation across domains is crucial. In this paper, we first propose to find such a representation through a new learning method, transfer component analysis (TCA), for domain adaptation. TCA tries to learn some transfer components across domains in a reproducing kernel Hilbert space using maximum mean miscrepancy. In the subspace spanned by these transfer components, data properties are preserved and data distributions in different domains are close to each other. As a result, with the new representations in this subspace, we can apply standard machine learning methods to train classifiers or regression models in the source domain for use in the target domain. Furthermore, in order to uncover the knowledge hidden in the relations between the data labels from the source and target domains, we extend TCA in a semisupervised learning setting, which encodes label information into transfer components learning. We call this extension semisupervised TCA. The main contribution of our work is that we propose a novel dimensionality reduction framework for reducing the distance between domains in a latent space for domain adaptation. We propose both unsupervised and semisupervised feature extraction approaches, which can dramatically reduce the distance between domain distributions by projecting data onto the learned transfer components. Finally, our approach can handle large datasets and naturally lead to out-of-sample generalization. The effectiveness and efficiency of our approach are verified by experiments on five toy datasets and two real-world applications: cross-domain indoor WiFi localization and cross-domain text classification.Keywords
This publication has 23 references indexed in Scilit:
- Dimensionality reduction for density ratio estimation in high-dimensional spacesNeural Networks, 2010
- Finding Stationary Subspaces in Multivariate Time SeriesPhysical Review Letters, 2009
- Change-Point Detection in Time-Series Data by Direct Density-Ratio Estimation2009
- Estimating Squared-Loss Mutual Information for Independent Component Analysis2009
- Optimizing the Kernel in the Empirical Feature SpaceIEEE Transactions on Neural Networks, 2005
- Measuring Statistical Dependence with Hilbert-Schmidt Norms2005
- Bias learning, knowledge sharingIEEE Transactions on Neural Networks, 2003
- An introduction to kernel-based learning algorithmsIEEE Transactions on Neural Networks, 2001
- 10.1162/153244302760185252Applied Physics Letters, 2000
- Nonlinear Component Analysis as a Kernel Eigenvalue ProblemNeural Computation, 1998