Structured Spike-and-Slab Variational Bayes for High-Dimensional Non-Normal Generalized Linear Mixed Models
Open Access
Abstract
High-dimensional non-normal longitudinal data are ubiquitous across fields such as genomics, biomedicine, microbiome research, and the social sciences. Such data often combine non-normal responses, within-subject dependence and sparse population effects. We develop a structured variational Bayesian procedure: variational Bayesian empirical likelihood with spike-and-slab priors, which combines an empirical-likelihood-motivated working kernel with two Laplace shrinkage branches. The variational family links each inclusion indicator to its coefficient and local scale, and it uses probability-weighted updates for global shrinkage. A scalar empirical-likelihood weighting implementation provides tractable computation, and conditional working-evidence scores compare random-effect covariance structures. Simulation studies examine selection, estimation, prediction, interval coverage, and sensitivity to numerical and prior settings. Two longitudinal microbiome applications yield interpretable conditional associations. The resulting framework provides an explicit computational construction for sparse mixed-model analysis, with numerical results characterizing its operating behavior.Keywords
Funding Information
- National Natural Science Foundation of China (12501404)
- Yunnan Fundamental Research Projects (202401AU070212)
- Yunnan Fundamental Research Projects (202401AS070152)
- Youth Project of Yunnan Xingdian Talent Program
This publication has 34 references indexed in Scilit:
- Auto-Encoding Variational Bayesian Inference in High-Dimensional Skew-Normal Linear Mixed ModelsJournal of Systems Science and Complexity, 2026
- Robust Bayesian high-dimensional variable selection and inference with the horseshoe family of priorsComputational Statistics & Data Analysis, 2026
- Bayesian empirical likelihood inference and order shrinkage for autoregressive modelsStatistical Papers, 2021
- Variable selection of high-dimensional non-parametric nonlinear systems by derivative averaging to avoid the curse of dimensionalityAutomatica, 2019
- Robust check loss-based variable selection of high-dimensional single-index varying-coefficient modelCommunications in Nonlinear Science and Numerical Simulation, 2016
- High dimensional generalized empirical likelihood for moment restrictions with dependent dataJournal of Econometrics, 2015
- Bayesian adaptive LassoAnnals of the Institute of Statistical Mathematics, 2013
- Generalized linear mixed models: a review and some extensionsLifetime Data Analysis, 2007
- On Bayesian model and variable selection using MCMCStatistics and Computing, 2002
- Bayesian Model Selection and Model AveragingJournal of Mathematical Psychology, 2000