Bayesian Sparse Group Selection
- 2 July 2016
- journal article
- research article
- Published by Taylor & Francis in Journal of Computational and Graphical Statistics
- Vol. 25 (3) , 665-683
Abstract
This article proposes a Bayesian approach for the sparse group selection problem in the regression model. In this problem, the variables are partitioned into different groups. It is assumed that only a small number of groups are active for explaining the response variable, and it is further assumed that within each active group only a small number of variables are active. We adopt a Bayesian hierarchical formulation, where each candidate group is associated with a binary variable indicating whether the group is active or not. Within each group, each candidate variable is also associated with a binary indicator, too. Thus, the sparse group selection problem can be solved by sampling from the posterior distribution of the two layers of indicator variables. We adopt a group-wise Gibbs sampler for posterior sampling. We demonstrate the proposed method by simulation studies as well as real examples. The simulation results show that the proposed method performs better than the sparse group Lasso in terms of selecting the active groups as well as identifying the active variables within the selected groups. Supplementary materials for this article are available online.Keywords
This publication has 22 references indexed in Scilit:
- Correlated variables in regression: Clustering and sparse estimationJournal of Statistical Planning and Inference, 2013
- Consistent Group Identification and Variable Selection in Regression With Correlated PredictorsJournal of Computational and Graphical Statistics, 2013
- A Sparse-Group LassoJournal of Computational and Graphical Statistics, 2013
- Nearly unbiased variable selection under minimax concave penaltyThe Annals of Statistics, 2010
- The Bayesian LassoJournal of the American Statistical Association, 2008
- Markov Chain Monte Carlo: Can We Trust the Third Significant Figure?Statistical Science, 2008
- Bayesian Variable Selection and Regularization for Time–Frequency Surface EstimationJournal of the Royal Statistical Society Series B: Statistical Methodology, 2004
- A gene expression database for the molecular pharmacology of cancerNature Genetics, 2000
- Nonparametric regression using Bayesian variable selectionJournal of Econometrics, 1996
- Variable Selection via Gibbs SamplingJournal of the American Statistical Association, 1993