Posterior contraction in group sparse logit models for categorical responses
Preprint
Abstract
This paper studies posterior contraction rates in multi-category logit models with priors incorporating group sparse structures. We consider a general class of logit models that includes the well-known multinomial logit models as a special case. Group sparsity is useful when predictor variables are naturally clustered and particularly useful for variable selection in the multinomial logit models. We provide a unified platform for posterior contraction rates of group-sparse logit models that include binary logistic regression under individual sparsity. No size restriction is directly imposed on the true signal in this study. In addition to establishing the first-ever contraction properties for multi-category logit models under group sparsity, this work also refines recent findings on the Bayesian theory of binary logistic regression.Keywords
All Related Versions
This publication has 28 references indexed in Scilit:
- Posterior contraction in sparse generalized linear modelsBiometrika, 2020
- Bounds on tail probabilities for quadratic forms in dependent sub-gaussian random variablesStatistics & Probability Letters, 2020
- Contraction properties of shrinkage priors in logistic regressionJournal of Statistical Planning and Inference, 2020
- Spike-and-Slab Group Lassos for Grouped Regression and Sparse Generalized Additive ModelsJournal of the American Statistical Association, 2020
- Bayesian group selection in logistic regression with application to MRI data analysisBiometrics, 2020
- Skinny Gibbs: A Consistent and Scalable Gibbs Sampler for Model SelectionJournal of the American Statistical Association, 2018
- Sparse group lasso and high dimensional multinomial classificationComputational Statistics & Data Analysis, 2014
- Oracle Inequalities for a Group Lasso Procedure Applied to Generalized Linear Models in High DimensionIEEE Transactions on Information Theory, 2014
- The Group Lasso for Logistic RegressionJournal of the Royal Statistical Society Series B: Statistical Methodology, 2008
- Model Selection and Estimation in Regression with Grouped VariablesJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005