Multiple-Shrinkage Multinomial Probit Models with Applications to Simulating Geographies in Public Use Data
Open Access
- 1 June 2013
- journal article
- Published by Institute of Mathematical Statistics in Bayesian Analysis
- Vol. 8 (2) , 453-478
Abstract
Multinomial outcomes with many levels can be challenging to model. Information typically accrues slowly with increasing sample size, yet the parameter space expands rapidly with additional covariates. Shrinking all regression parameters towards zero, as often done in models of continuous or binary response variables, is unsatisfactory, since setting parameters equal to zero in multinomial models does not necessarily imply “no effect.” We propose an approach to modeling multinomial outcomes with many levels based on a Bayesian multinomial probit (MNP) model and a multiple shrinkage prior distribution for the regression parameters. The prior distribution encourages the MNP regression parameters to shrink toward a number of learned locations, thereby substantially reducing the dimension of the parameter space. Using simulated data, we compare the predictive performance of this model against two other recently-proposed methods for big multinomial models. The results suggest that the fully Bayesian, multiple shrinkage approach can outperform these other methods. We apply the multiple shrinkage MNP to simulating replacement values for areal identifiers, e.g., census tract indicators, in order to protect data confidentiality in public use datasets.Keywords
This publication has 29 references indexed in Scilit:
- Bayesian nonparametric estimation and consistency of mixed multinomial logit choice modelsBernoulli, 2010
- Bayesian Semiparametric Multiple ShrinkageBiometrics, 2010
- Bayesian lasso regressionBiometrika, 2009
- The Bayesian LassoJournal of the American Statistical Association, 2008
- The Multiple Adaptations of Multiple ImputationJournal of the American Statistical Association, 2007
- Hierarchical Dirichlet ProcessesJournal of the American Statistical Association, 2006
- A Bayesian analysis of the multinomial probit model using marginal data augmentationJournal of Econometrics, 2005
- Approximate Dirichlet Process Computing in Finite Normal MixturesJournal of Computational and Graphical Statistics, 2002
- Retire to where? A discrete choice model of residential locationInternational Journal of Population Geography, 2001
- An exact likelihood analysis of the multinomial probit modelJournal of Econometrics, 1994