Deriving Probability Density Functions from Probabilistic Functional Programs
Authors:
- Sooraj BhatSBSooraj Bhat
- Johannes BorgströmJBJohannes Borgström
- Andrew D. GordonAGAndrew D. Gordon
- Claudio RussoCRClaudio Russo
Preprint
Abstract
The probability density function of a probability distribution is a fundamental concept in probability theory and a key ingredient in various widely used machine learning methods. However, the necessary framework for compiling probabilistic functional programs to density functions has only recently been developed. In this work, we present a density compiler for a probabilistic language with failure and both discrete and continuous distributions, and provide a proof of its soundness. The compiler greatly reduces the development effort of domain experts, which we demonstrate by solving inference problems from various scientific applications, such as modelling the global carbon cycle, using a standard Markov chain Monte Carlo framework.Keywords
All Related Versions
This publication has 8 references indexed in Scilit:
- The climate dependence of the terrestrial carbon cycle, including parameter and structural uncertaintiesBiogeosciences, 2013
- A model-learner pattern for bayesian reasoningACM SIGPLAN Notices, 2013
- Fine‐scale environmental variation in species distribution modelling: regression dilution, latent variables and neighbourly adviceMethods in Ecology and Evolution, 2011
- Stochastic lambda calculus and monads of probability distributionsACM SIGPLAN Notices, 2002
- Parametric Statistical Modeling by Minimum Integrated Square ErrorTechnometrics, 2001
- The Change-of-Variables Formula Using Matrix VolumeSIAM Journal on Matrix Analysis and Applications, 1999
- A Language and Program for Complex Bayesian ModellingJournal of the Royal Statistical Society: Series D (The Statistician), 1994
- A Model of Set-Theory in Which Every Set of Reals is Lebesgue MeasurableAnnals of Mathematics, 1970