Model Uncertainty and Missing Data: An Objective Bayesian Perspective (with Discussion)
Open Access
- 1 December 2025
- journal article
- Published by Institute of Mathematical Statistics in Bayesian Analysis
- Vol. 20 (4) , 1-73
Abstract
The interplay between missing data and model uncertainty—two classic statistical problems—leads to primary questions that we formally address from an objective Bayesian perspective. For the general regression problem, we discuss the probabilistic justification of Rubin’s rules applied to the usual components of Bayesian variable selection, arguing that prior predictive marginals should be central to the pursued methodology. In the regression settings, we explore the conditions of prior distributions that make the missing data mechanism ignorable, provided that it is missing at random or completely at random. Moreover, when comparing multiple linear models, we provide a complete methodology for dealing with special cases, such as variable selection or uncertainty regarding model errors. In numerous simulation experiments, we demonstrate that our method outperforms or equals others, in consistently producing results close to those obtained using the full dataset. In general, the difference increases with the percentage of missing data and the correlation between the variables used for imputation. Finally, we summarize possible directions for future research.Keywords
All Related Versions
This publication has 47 references indexed in Scilit:
- A Bayesian Approach Towards Missing Covariate Data in Multilevel Latent Regression ModelsPsychometrika, 2023
- Computing Bayes factors from data with missing values.Psychological Methods, 2019
- Dealing with missing covariates in epidemiologic studies: a comparison between multiple imputation and a full Bayesian approachStatistics in Medicine, 2016
- A First Course in Bayesian Statistical Methods2009
- Bayesian variable selection for the Cox regression model with missing covariatesLifetime Data Analysis, 2008
- An exploration of aspects of Bayesian multiple testingJournal of Statistical Planning and Inference, 2006
- Statistical Analysis with Missing Data2002
- Benchmark priors for Bayesian model averagingJournal of Econometrics, 2001
- Bayes FactorsJournal of the American Statistical Association, 1995
- Posterior odds ratios for selected regression hypothesesTrabajos de estadistica y de investigacion operativa, 1980