Review of Bayesian selection methods for categorical predictors using JAGS
Authors:
- 21 March 2021
- journal article
- review article
- Published by Taylor & Francis in Journal of Applied Statistics
- Vol. 49 (9) , 2370-2388
Abstract
The formulation of variable selection has been widely developed in the Bayesian literature by linking a random binary indicator to each variable. This Bayesian inference has the advantage of stochastically exploring the set of possible sub-models, whatever their dimension. Bayesian selection approaches, appropriate for categorical predictors, are generally beyond the scope of the standard Bayesian selection of regressors in the linear model since all levels of a categorical variable should be jointly handled in the selection procedure. For categorical covariates, new strategies have been developed to detect the effect of grouped covariates rather than the single effect of a quantitative regressor. In this paper, we review three Bayesian selection methods for categorical predictors: Bayesian Group Lasso with Spike and Slab priors, Bayesian Sparse Group Selection and Bayesian Effect Fusion using model-based clustering. The motivation behind this paper is to provide detailed information about the implementation of the three Bayesian selection methods mentioned above, appropriate for categorical predictors, using the JAGS software. Selection performance and sensitivity analysis of the hyperparameters tuning for prior specifications are assessed under various simulated scenarios. JAGS helps user implement these three Bayesian selection methods for more complex model structures such as hierarchical ones with latent layers.Keywords
This publication has 24 references indexed in Scilit:
- Bootstrapping Lasso EstimatorsJournal of the American Statistical Association, 2011
- Sharp Thresholds for High-Dimensional and Noisy Sparsity Recovery Using $\ell _{1}$-Constrained Quadratic Programming (Lasso)IEEE Transactions on Information Theory, 2009
- Model Selection and Estimation in Regression with Grouped VariablesJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- Sparsity and Smoothness Via the Fused LassoJournal of the Royal Statistical Society Series B: Statistical Methodology, 2004
- Optimal predictive model selectionThe Annals of Statistics, 2004
- Least angle regressionThe Annals of Statistics, 2004
- Asymptotics for lasso-type estimatorsThe Annals of Statistics, 2000
- The Effect of Improper Priors on Gibbs Sampling in Hierarchical Linear Mixed ModelsJournal of the American Statistical Association, 1996
- Variable Selection via Gibbs SamplingJournal of the American Statistical Association, 1993
- Bayesian Variable Selection in Linear RegressionJournal of the American Statistical Association, 1988