Sparse joint shift in multinomial classification
Author:
Preprint
Abstract
Sparse joint shift (SJS) was recently proposed as a tractable model for general dataset shift which may cause changes to the marginal distributions of features and labels as well as the posterior probabilities and the class-conditional feature distributions. Fitting SJS for a target dataset without label observations may produce valid predictions of labels and estimates of class prior probabilities. We present new results on the transmission of SJS from sets of features to larger sets of features, a conditional correction formula for the class posterior probabilities under the target distribution, identifiability of SJS, and the relationship between SJS and covariate shift. In addition, we point out inconsistencies in the algorithms which were proposed for estimating the characteristics of SJS, as they could hamper the search for optimal solutions.Keywords
All Related Versions
This publication has 11 references indexed in Scilit:
- Factorizable Joint Shift in Multinomial ClassificationMachine Learning and Knowledge Extraction, 2022
- Calibrating sufficientlyStatistics, 2021
- Importance Weight Estimation and Generalization in Domain Adaptation Under Label ShiftIEEE Transactions on Pattern Analysis and Machine Intelligence, 2021
- Adapting a classification rule to local and global shift when only unlabelled data are availableEuropean Journal of Operational Research, 2015
- The role of the information set for forecasting—with applications to risk managementThe Annals of Applied Statistics, 2014
- Density Ratio Estimation in Machine Learning2012
- A unifying view on dataset shift in classificationPattern Recognition, 2012
- Quantifying counts and costs via classificationData Mining and Knowledge Discovery, 2008
- Adjusting the Outputs of a Classifier to New aPrioriProbabilities: A Simple ProcedureNeural Computation, 2002
- Improving predictive inference under covariate shift by weighting the log-likelihood functionJournal of Statistical Planning and Inference, 2000