Adaptive Bayesian multivariate density estimation with Dirichlet mixtures
- 2 June 2013
- journal article
- research article
- Published by Oxford University Press (OUP) in Biometrika
- Vol. 100 (3) , 623-640
Abstract
We show that rate-adaptive multivariate density estimation can be performed using Bayesian methods based on Dirichlet mixtures of normal kernels with a prior distribution on the kernel's covariance matrix parameter. We derive sufficient conditions on the prior specification that guarantee convergence to a true density at a rate that is minimax optimal for the smoothness class to which the true density belongs. No prior knowledge of smoothness is assumed. The sufficient conditions are shown to hold for the Dirichlet location mixture-of-normals prior with a Gaussian base measure and an inverse Wishart prior on the covariance matrix parameter. Locally Hölder smoothness classes and their anisotropic extensions are considered. Our study involves several technical novelties, including sharp approximation of finitely differentiable multivariate densities by normal mixtures and a new sieve on the space of such densities.Keywords
All Related Versions
This publication has 19 references indexed in Scilit:
- Adaptive nonparametric Bayesian inference using location-scale mixture priorsThe Annals of Statistics, 2010
- Nonparametric Bayesian model selection and averagingElectronic Journal of Statistics, 2008
- Posterior convergence rates of Dirichlet mixtures at smooth densitiesThe Annals of Statistics, 2007
- Adaptive Bayesian inference on the mean of an infinite-dimensional normal distributionThe Annals of Statistics, 2003
- Entropies and rates of convergence for maximum likelihood and Bayes estimation for mixtures of normal densitiesThe Annals of Statistics, 2001
- Convergence rates of posterior distributionsThe Annals of Statistics, 2000
- Posterior consistency of Dirichlet mixtures in density estimationThe Annals of Statistics, 1999
- Risk bounds for model selection via penalizationProbability Theory and Related Fields, 1999
- Bayesian Density Estimation and Inference Using MixturesJournal of the American Statistical Association, 1995
- A Bayesian Analysis of Some Nonparametric ProblemsThe Annals of Statistics, 1973