Computationally Efficient Bayesian Estimation of High Dimensional Copulas with Discrete and Mixed Margins
Authors:
Preprint
Abstract
Estimating copulas with discrete marginal distributions is challenging, especially in high dimensions, because computing the likelihood contribution of each observation requires evaluating $2^{J}$ terms, with $J$ the number of discrete variables. Currently, data augmentation methods are used to carry out inference for discrete copula and, in practice, the computation becomes infeasible when $J$ is large. Our article proposes two new fast Bayesian approaches for estimating high dimensional copulas with discrete margins, or a combination of discrete and continuous margins. Both methods are based on recent advances in Bayesian methodology that work with an unbiased estimate of the likelihood rather than the likelihood itself, and our key observation is that we can estimate the likelihood of a discrete copula unbiasedly with much less computation than evaluating the likelihood exactly or with current simulation methods that are based on augmenting the model with latent variables. The first approach builds on the pseudo marginal method that allows Markov chain Monte Carlo simulation from the posterior distribution using only an unbiased estimate of the likelihood. The second approach is based on a Variational Bayes approximation to the posterior and also uses an unbiased estimate of the likelihood. We show that Monte Carlo and randomised quasi Monte Carlo methods can be used with both approaches to reduce the variability of the estimate of the likelihood, and hence enable us to carry out Bayesian inference for high values of $J$ for some classes of copulas where the computation was previously too expensive. Our article also introduces {\em a correlated quasi random number pseudo marginal} approach into the literature. The methodology is illustrated through several real and simulated data examples.
Keywords
All Related Versions
This publication has 23 references indexed in Scilit:
- Model selection for discrete regular vine copulasComputational Statistics & Data Analysis, 2017
- Adaptive optimal scaling of Metropolis–Hastings algorithms using the Robbins–Monro processCommunications in Statistics - Theory and Methods, 2016
- Efficient implementation of Markov chain Monte Carlo when using an unbiased likelihood estimatorBiometrika, 2015
- Bayesian Gaussian Copula Factor Models for Mixed DataJournal of the American Statistical Association, 2013
- High-dimensional integration: The quasi-Monte Carlo wayActa Numerica, 2013
- Pair Copula Constructions for Multivariate Discrete DataJournal of the American Statistical Association, 2012
- BAYESIAN INFERENCE BASED ONLY ON SIMULATED LIKELIHOOD: PARTICLE FILTER ANALYSIS OF DYNAMIC ECONOMIC MODELSEconometric Theory, 2011
- Computation of Multivariate Normal and t Probabilities2009
- Efficient Bayesian inference for Gaussian copula regression modelsBiometrika, 2006
- On theL2-Discrepancy for Anchored BoxesJournal of Complexity, 1998