Bayesian mixture modeling for multivariate conditional distributions
Authors:
- Maria DeYoreoMDMaria DeYoreo
- Jerome P. ReiterJRJerome P. Reiter
Preprint
Abstract
We present a Bayesian mixture model for estimating the joint distribution of mixed ordinal, nominal, and continuous data conditional on a set of fixed variables. The model uses multivariate normal and categorical mixture kernels for the random variables. It induces dependence between the random and fixed variables through the means of the multivariate normal mixture kernels and via a truncated local Dirichlet process. The latter encourages observations with similar values of the fixed variables to share mixture components. Using a simulation of data fusion, we illustrate that the model can estimate underlying relationships in the data and the distributions of the missing values more accurately than a mixture model applied to the random and fixed variables jointly. We use the model to analyze consumers' reading behaviors using a quota sample, i.e., a sample where the empirical distribution of some variables is fixed by design and so should not be modeled as random, conducted by the book publisher HarperCollins.Keywords
All Related Versions
This publication has 24 references indexed in Scilit:
- Nonparametric Bayes modeling with sample survey weightsStatistics & Probability Letters, 2016
- Nonparametric Bayes inference on conditional independenceBiometrika, 2016
- Are Independent Parameter Draws Necessary for Multiple Imputation?The American Statistician, 2013
- Bayesian modeling of joint and conditional distributionsJournal of Econometrics, 2012
- Nonparametric Bayes Regression and Classification Through Mixtures of Product Kernels2011
- The local Dirichlet processAnnals of the Institute of Statistical Mathematics, 2009
- Normalized Mutual Information Feature SelectionIEEE Transactions on Neural Networks, 2009
- Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancyIEEE Transactions on Pattern Analysis and Machine Intelligence, 2005
- Bayesian curve fitting using multivariate normal mixturesBiometrika, 1996
- Using mutual information for selecting features in supervised neural net learningIEEE Transactions on Neural Networks, 1994