Adapting to Latent Subgroup Shifts via Concepts and Proxies
Preprint
Abstract
We address the problem of unsupervised domain adaptation when the source domain differs from the target domain because of a shift in the distribution of a latent subgroup. When this subgroup confounds all observed data, neither covariate shift nor label shift assumptions apply. We show that the optimal target predictor can be non-parametrically identified with the help of concept and proxy variables available only in the source domain, and unlabeled data from the target. The identification results are constructive, immediately suggesting an algorithm for estimating the optimal predictor in the target. For continuous observations, when this algorithm becomes impractical, we propose a latent variable model specific to the data generation process at hand. We show how the approach degrades as the size of the shift changes, and verify that it outperforms both covariate and label shift adjustment.Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- Non-parametric inference about mean functionals of non-ignorable non-response data without identifying the joint distributionJournal of the Royal Statistical Society Series B: Statistical Methodology, 2023
- Generalizing to Unseen Domains: A Survey on Domain GeneralizationIEEE Transactions on Knowledge and Data Engineering, 2022
- Concept whitening for interpretable image recognitionNature Machine Intelligence, 2020
- Identifying causal effects with proxy variables of an unmeasured confounderBiometrika, 2018
- Measurement bias and effect restoration in causal inferenceBiometrika, 2014
- A theory of learning from different domainsMachine Learning, 2009
- Attribute and simile classifiers for face verification2009
- Quantifying counts and costs via classificationData Mining and Knowledge Discovery, 2008
- Multiple-Bias Modelling for Analysis of Observational DataJournal of the Royal Statistical Society Series A: Statistics in Society, 2005
- Improving predictive inference under covariate shift by weighting the log-likelihood functionJournal of Statistical Planning and Inference, 2000