Finding factors influencing risk: Comparing Bayesian stochastic search and standard variable selection methods applied to logistic regression models of cases and controls
- 20 October 2008
- journal article
- research article
- Published by Wiley in Statistics in Medicine
- Vol. 27 (29) , 6158-6174
Abstract
When modeling the risk of a disease, the very act of selecting the factors to be included can heavily impact the results. This study compares the performance of several variable selection techniques applied to logistic regression. We performed realistic simulation studies to compare five methods of variable selection: (1) a confidence interval (CI) approach for significant coefficients, (2) backward selection, (3) forward selection, (4) stepwise selection, and (5) Bayesian stochastic search variable selection (SSVS) using both informed and uniformed priors. We defined our simulated diseases mimicking odds ratios for cancer risk found in the literature for environmental factors, such as smoking; dietary risk factors, such as fiber; genetic risk factors, such as XPD; and interactions. We modeled the distribution of our covariates, including correlation, after the reported empirical distributions of these risk factors. We also used a null data set to calibrate the priors of the Bayesian method and evaluate its sensitivity. Of the standard methods (95 per cent CI, backward, forward, and stepwise selection) the CI approach resulted in the highest average per cent of correct associations and the lowest average per cent of incorrect associations. SSVS with an informed prior had a higher average per cent of correct associations and a lower average per cent of incorrect associations than the CI approach. This study shows that the Bayesian methods offer a way to use prior information to both increase power and decrease false‐positive results when selecting factors to model complex disease risk. Copyright © 2008 John Wiley & Sons, Ltd.Keywords
This publication has 39 references indexed in Scilit:
- Dissecting Effects of Complex MixturesEpidemiology, 2007
- Model selection and Bayesian methods in statistical genetics: Summary of Group 11 contributions to Genetic Analysis Workshop 15Genetic Epidemiology, 2007
- Sample Size Implications when Biases are Modelled Rather than IgnoredJournal of the Royal Statistical Society Series A: Statistics in Society, 2006
- The Practical Implementation of Bayesian Model Selection2001
- The Variable Selection ProblemJournal of the American Statistical Association, 2000
- Identifiability, Improper Priors, and Gibbs Sampling for Generalized Linear ModelsJournal of the American Statistical Association, 1999
- Bayes FactorsJournal of the American Statistical Association, 1995
- Model Selection and Accounting for Model Uncertainty in Graphical Models Using Occam's WindowJournal of the American Statistical Association, 1994
- Variable Selection via Gibbs SamplingJournal of the American Statistical Association, 1993
- Bayesian Variable Selection in Linear RegressionJournal of the American Statistical Association, 1988