Estimating Mixture of Dirichlet Process Models
Authors:
- 1 June 1998
- journal article
- research article
- Published by Taylor & Francis in Journal of Computational and Graphical Statistics
- Vol. 7 (2) , 223-238
Abstract
Current Gibbs sampling schemes in mixture of Dirichlet process (MDP) models are restricted to using “conjugate” base measures that allow analytic evaluation of the transition probabilities when resampling configurations, or alternatively need to rely on approximate numeric evaluations of some transition probabilities. Implementation of Gibbs sampling in more general MDP models is an open and important problem because most applications call for the use of nonconjugate base measures. In this article we propose a conceptual framework for computational strategies. This framework provides a perspective on current methods, facilitates comparisons between them, and leads to several new methods that expand the scope of MDP models to nonconjugate situations. We discuss one in detail. The basic strategy is based on expanding the parameter vector, and is applicable for MDP models with arbitrary base measure and likelihood. Strategies are also presented for the important class of normal-normal MDP models and for problems with fixed or few hyperparameters. The proposed algorithms are easily implemented and illustrated with an application.Keywords
This publication has 17 references indexed in Scilit:
- A semiparametric Bayesian model for randomised block designsBiometrika, 1996
- Nonparametric hierarchical Bayes via sequential imputationsThe Annals of Statistics, 1996
- Bayesian Inference for Semiparametric Binary RegressionJournal of the American Statistical Association, 1996
- Bayesian density estimation via dirichlet density processesJournal of Nonparametric Statistics, 1996
- Bayesian Density Estimation and Inference Using MixturesJournal of the American Statistical Association, 1995
- Markov Chains for Exploring Posterior DistributionsThe Annals of Statistics, 1994
- Bayesian Nonparametric Estimation for Incomplete Data Via Successive Substitution SamplingThe Annals of Statistics, 1994
- Estimating Normal Means with a Dirichlet Process PriorJournal of the American Statistical Association, 1994
- Estimating normal means with a conjugate style dirichlet process priorCommunications in Statistics - Simulation and Computation, 1994
- Nonparametric Bayesian bioassay including ordered polytomous responseBiometrika, 1991