Variable Selection for Nonparametric Gaussian Process Priors: Models and Computational Strategies
Open Access
- 1 February 2011
- journal article
- research article
- Published by Institute of Mathematical Statistics in Statistical Science
- Vol. 26 (1) , 130-149
Abstract
This paper presents a unified treatment of Gaussian process models that extends to data from the exponential dispersion family and to survival data. Our specific interest is in the analysis of data sets with predictors that have an a priori unknown form of possibly nonlinear associations to the response. The modeling approach we describe incorporates Gaussian processes in a generalized linear model framework to obtain a class of nonparametric regression models where the covariance matrix depends on the predictors. We consider, in particular, continuous, categorical and count responses. We also look into models that account for survival outcomes. We explore alternative covariance formulations for the Gaussian process prior and demonstrate the flexibility of the construction. Next, we focus on the important problem of selecting variables from the set of possible predictors and describe a general framework that employs mixture priors. We compare alternative MCMC strategies for posterior inference and achieve a computationally efficient and practical approach. We demonstrate performances on simulated and benchmark data sets.Keywords
All Related Versions
This publication has 44 references indexed in Scilit:
- Bayesian Treed Gaussian Process Models With an Application to Computer ModelingJournal of the American Statistical Association, 2008
- Gaussian Process Models for Computer Experiments With Qualitative and Quantitative FactorsTechnometrics, 2008
- Gaussian Predictive Process Models for Large Spatial Data SetsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2008
- Bayesian identification, selection and estimation of semiparametric functions in high-dimensional additive modelsJournal of Econometrics, 2008
- Mixtures of g Priors for Bayesian Variable SelectionJournal of the American Statistical Association, 2008
- A Decision-Theoretic Generalization of On-Line Learning and an Application to BoostingJournal of Computer and System Sciences, 1997
- Reversible jump Markov chain Monte Carlo computation and Bayesian model determinationBiometrika, 1995
- Variable Selection via Gibbs SamplingJournal of the American Statistical Association, 1993
- Bayesian Analysis of Binary and Polychotomous Response DataJournal of the American Statistical Association, 1993
- Estimating Optimal Transformations for Multiple Regression and CorrelationJournal of the American Statistical Association, 1985