Bayesian latent variable regression via Gibbs sampling: methodology and practical aspects
Authors:
- 2 October 2007
- journal article
- research article
- Published by Wiley in Journal of Chemometrics
- Vol. 21 (12) , 578-591
Abstract
Bayesian latent variable regression (BLVR) aims to utilize all available information for empirical modeling via a Bayesian framework. Such information includes prior knowledge about the underlying variables, model parameters and measurement error distributions. This paper improves upon the existing optimization‐based BLVR (BLVR‐OPT) method [1] by developing a sampling‐based Bayesian latent variable regression (BLVR‐S) method that relies on Gibbs sampling. Use of the sampling‐based framework not only provides point estimates, but its ability to generate samples that represent the posterior distribution of the unknown variables, also readily provides error bounds. Features and advantages of this method are demonstrated via examples based on simulated data and real Near‐Infrared (NIR) spectroscopy data. Practical aspects of Bayesian modeling such as determining when the extra computation may be worth the effort are addressed by an empirical study of the effects of the amount of training data and signal to noise ratio (SNR). The benefits of BLVR seem to be most significant when the number of measurements is limited and when noise in output variables is relatively large. Copyright © 2007 John Wiley & Sons, Ltd.Keywords
This publication has 29 references indexed in Scilit:
- Parameter Estimation in the Error-in-Variables Models Using the Gibbs SamplerThe Canadian Journal of Chemical Engineering, 2008
- Dealing with Collinearity in Finite Impulse Response Models Using Bayesian ShrinkageIndustrial & Engineering Chemistry Research, 2005
- Bayesian parameter estimation with informative priors for nonlinear systemsAIChE Journal, 2005
- Elicited Priors for Bayesian Model Specifications in Political Science ResearchThe Journal of Politics, 2005
- Bayesian principal component analysisJournal of Chemometrics, 2002
- Determining environmental standards using bootstrapping, bayesian and maximum likelihood techniques: a comparative studyAnalytica Chimica Acta, 2001
- Non-linear regression analysis: new approach to traditional implementationsJournal of Chemometrics, 2000
- Maximum likelihood principal component analysisJournal of Chemometrics, 1997
- Maximum Likelihood Multivariate CalibrationAnalytical Chemistry, 1997
- Markov Chains for Exploring Posterior DistributionsThe Annals of Statistics, 1994