Applications of Bayesian shrinkage prior models in clinical research with categorical responses
Open Access
- 28 April 2022
- journal article
- research article
- Published by Springer Nature in BMC Medical Research Methodology
- Vol. 22 (1) , 1-19
Abstract
Background: Prediction and classification algorithms are commonly used in clinical research for identifying patients susceptible to clinical conditions such as diabetes, colon cancer, and Alzheimer’s disease. Developing accurate prediction and classification methods benefits personalized medicine. Building an excellent predictive model involves selecting the features that are most significantly associated with the outcome. These features can include several biological and demographic characteristics, such as genomic biomarkers and health history. Such variable selection becomes challenging when the number of potential predictors is large. Bayesian shrinkage models have emerged as popular and flexible methods of variable selection in regression settings. This work discusses variable selection with three shrinkage priors and illustrates its application to clinical data such as Pima Indians Diabetes, Colon cancer, ADNI, and OASIS Alzheimer’s real-world data.Methods: A unified Bayesian hierarchical framework that implements and compares shrinkage priors in binary and multinomial logistic regression models is presented. The key feature is the representation of the likelihood by a Polya-Gamma data augmentation, which admits a natural integration with a family of shrinkage priors, specifically focusing on Horseshoe, Dirichlet Laplace, and Double Pareto priors. Extensive simulation studies are conducted to assess the performances under different data dimensions and parameter settings. Measures of accuracy, AUC, brier score, L1 error, cross-entropy, and ROC surface plots are used as evaluation criteria comparing the priors with frequentist methods as Lasso, Elastic-Net, and Ridge regression.Results: All three priors can be used for robust prediction on significant metrics, irrespective of their categorical response model choices. Simulation studies could achieve the mean prediction accuracy of 91.6% (95% CI: 88.5, 94.7) and 76.5% (95% CI: 69.3, 83.8) for logistic regression and multinomial logistic models, respectively. The model can identify significant variables for disease risk prediction and is computationally efficient.Conclusions: The models are robust enough to conduct both variable selection and prediction because of their high shrinkage properties and applicability to a broad range of classification problems.Keywords
All Related Versions
This publication has 41 references indexed in Scilit:
- Combining multiple hypothesis testing and affinity propagation clustering leads to accurate, robust and sample size independent classification on gene expression dataBMC Bioinformatics, 2012
- Review of biomarkers in colorectal cancerColorectal Disease, 2011
- Predicting Alzheimer's risk: why and how?Alzheimer's Research & Therapy, 2011
- A Bayesian Shrinkage Model for Incomplete Longitudinal Binary Data With Application to the Breast Cancer Prevention TrialJournal of the American Statistical Association, 2010
- Open Access Series of Imaging Studies: Longitudinal MRI Data in Nondemented and Demented Older AdultsJournal of Cognitive Neuroscience, 2010
- Spike and slab variable selection: Frequentist and Bayesian strategiesThe Annals of Statistics, 2005
- Variable Selection via Gibbs SamplingJournal of the American Statistical Association, 1993
- Bayesian Analysis of Binary and Polychotomous Response DataJournal of the American Statistical Association, 1993
- Bayesian Variable Selection in Linear RegressionJournal of the American Statistical Association, 1988
- Ridge Regression: Biased Estimation for Nonorthogonal ProblemsTechnometrics, 1970