Variational Polya Tree
Preprint
Abstract
Density estimation is essential for generative modeling, particularly with the rise of modern neural networks. While existing methods capture complex data distributions, they often lack interpretability and uncertainty quantification. Bayesian nonparametric methods, especially the \polya tree, offer a robust framework that addresses these issues by accurately capturing function behavior over small intervals. Traditional techniques like Markov chain Monte Carlo (MCMC) face high computational complexity and scalability limitations, hindering the use of Bayesian nonparametric methods in deep learning. To tackle this, we introduce the variational \polya tree (VPT) model, which employs stochastic variational inference to compute posterior distributions. This model provides a flexible, nonparametric Bayesian prior that captures latent densities and works well with stochastic gradient optimization. We also leverage the joint distribution likelihood for a more precise variational posterior approximation than traditional mean-field methods. We evaluate the model performance on both real data and images, and demonstrate its competitiveness with other state-of-the-art deep density estimation methods. We also explore its ability in enhancing interpretability and uncertainty quantification. Code is available at https://github.com/howardchanth/var-polya-tree.Keywords
All Related Versions
This publication has 5 references indexed in Scilit:
- Bayesian Nonparametric Analysis of Restricted Mean Survival TimeBiometrics, 2022
- AMF: Aggregated Mondrian Forests for Online LearningJournal of the Royal Statistical Society Series B: Statistical Methodology, 2021
- Density estimation using deep generative neural networksProceedings of the National Academy of Sciences, 2021
- A review of uncertainty quantification for density estimationStatistics Surveys, 2021
- Projective limit random probabilities on Polish spacesElectronic Journal of Statistics, 2011