Feature Space Independent Semi-Supervised Domain Adaptation via Kernel Matching
Authors:
- 25 July 2014
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 37 (1) , 54-66
Abstract
Domain adaptation methods aim to learn a good prediction model in a label-scarce target domain by leveraging labeled patterns from a related source domain where there is a large amount of labeled data. However, in many practical domain adaptation learning scenarios, the feature distribution in the source domain is different from that in the target domain. In the extreme, the two distributions could differ completely when the feature representation of the source domain is totally different from that of the target domain. To address the problems of substantial feature distribution divergence across domains and heterogeneous feature representations of different domains, we propose a novel feature space independent semi-supervised kernel matching method for domain adaptation in this work. Our approach learns a prediction function on the labeled source data while mapping the target data points to similar source data points by matching the target kernel matrix to a submatrix of the source kernel matrix based on a Hilbert Schmidt Independence Criterion. We formulate this simultaneous learning and mapping process as a non-convex integer optimization problem and present a local minimization procedure for its relaxed continuous form. We evaluate the proposed kernel matching method using both cross domain sentiment classification tasks of Amazon product reviews and cross language text classification tasks of Reuters multilingual newswire stories. Our empirical results demonstrate that the proposed kernel matching method consistently and significantly outperforms comparison methods on both cross domain classification problems with homogeneous feature spaces and cross domain classification problems with heterogeneous feature spaces.Keywords
This publication has 12 references indexed in Scilit:
- Domain Adaptive Classification2013
- Semi-supervised Domain Adaptation with Instance Constraints2013
- What you saw is not what you get: Domain adaptation using asymmetric kernel transforms2011
- Transfer Learning on Heterogenous Feature Spaces via Spectral Transformation2010
- Beyond 2D-grids2010
- Domain adaptation from multiple sources via auxiliary classifiers2009
- Co-adaptation: Adaptive co-training for semi-supervised learning2009
- Domain adaptation with structural correspondence learning2006
- Measuring Statistical Dependence with Hilbert-Schmidt Norms2005
- Improving predictive inference under covariate shift by weighting the log-likelihood functionJournal of Statistical Planning and Inference, 2000