Importance Weighted Import Vector Machine for Unsupervised Domain Adaptation
- 27 October 2016
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cybernetics
- Vol. 47 (10) , 3280-3292
Abstract
In real-world applications, the assumption of independent and identical distribution is no longer consistent. To alleviate the significant mismatch between source and target domains, importance weighting import vector machine, which is an adaptive classifier, is proposed. This adaptive probabilistic classification method, which is sparse and computationally efficient, can be used for unsupervised domain adaptation (DA). The effectiveness of the proposed approach is demonstrated via a toy problem, and a real-world cross-domain object recognition task. Even though the sparseness, the proposed method outperforms the state-of-the-art in both unsupervised and semisupervised DA scenarios. We also introduce a reliable importance weighted cross validation (RIWCV), which is an improvement of importance weighted cross validation, for parameter and model selection. The RIWCV avoid falling down in local minimum, by selecting a more reliable combination of the parameters instead of the best parameters.Keywords
Funding Information
- Portuguese Foundation for Science and Technology FCT (SFRH/BD/81828/2011, AMS-HMI12: RECI/EEI-AUT/ 0181/2012)
- COMPETE
This publication has 34 references indexed in Scilit:
- Relative Density-Ratio Estimation for Robust Distribution ComparisonNeural Computation, 2013
- I2VM: Incremental import vector machinesImage and Vision Computing, 2012
- Multi-task clustering via domain adaptationPattern Recognition, 2011
- A theory of learning from different domainsMachine Learning, 2009
- Semi-supervised speaker identification under covariate shiftSignal Processing, 2009
- Direct Density Ratio Estimation for Large-scale Covariate Shift AdaptationJournal of Information Processing, 2009
- Kernel Logistic Regression and the Import Vector MachineJournal of Computational and Graphical Statistics, 2005
- Improving predictive inference under covariate shift by weighting the log-likelihood functionJournal of Statistical Planning and Inference, 2000
- Sample Selection Bias as a Specification ErrorEconometrica, 1979
- A Correspondence Between Bayesian Estimation on Stochastic Processes and Smoothing by SplinesThe Annals of Mathematical Statistics, 1970