Clustered Bayesian Model Averaging
Authors:
- Qingzhao YuQYQingzhao Yu
- Steven N. MacEachernSMSteven N. MacEachern
- Mario PeruggiaMPMario Peruggia
Open Access
- 1 December 2013
- journal article
- Published by Institute of Mathematical Statistics in Bayesian Analysis
- Vol. 8 (4) , 883-908
Abstract
It is sometimes preferable to conduct statistical analyses based on the combination of several models rather than on the selection of a single model, thus taking into account the uncertainty about the true model. Models are usually combined using constant weights that do not distinguish between different regions of the covariate space. However, a procedure that performs well in a given situation may not do so in another situation. In this paper, we propose the concept of local Bayes factors, where we calculate the Bayes factors by restricting the models to regions of the covariate space. The covariate space is split in such a way that the relative model efficiencies of the various Bayesian models are about the same in the same region while differing in different regions. An algorithm for clustered Bayes averaging is then proposed for model combination, where local Bayes factors are used to guide the weighting of the Bayesian models. Simulations and real data studies show that clustered Bayesian averaging results in better predictive performance compared to a single Bayesian model or Bayesian model averaging where models are combined using the same weights over the entire covariate space.Keywords
This publication has 26 references indexed in Scilit:
- Bayesian Adaptive Sampling for Variable Selection and Model AveragingJournal of Computational and Graphical Statistics, 2011
- Bayesian Treed Gaussian Process Models With an Application to Computer ModelingJournal of the American Statistical Association, 2008
- Methods and Criteria for Model SelectionJournal of the American Statistical Association, 2004
- Adaptive Regression by MixingJournal of the American Statistical Association, 2001
- The Intrinsic Bayes Factor for Model Selection and PredictionJournal of the American Statistical Association, 1996
- Bayes FactorsJournal of the American Statistical Association, 1995
- Model Selection and Accounting for Model Uncertainty in Graphical Models Using Occam's WindowJournal of the American Statistical Association, 1994
- Variable Selection via Gibbs SamplingJournal of the American Statistical Association, 1993
- Multivariate Adaptive Regression SplinesThe Annals of Statistics, 1991
- A Predictive Approach to Model SelectionJournal of the American Statistical Association, 1979