Reconstructing the universe with variational self-boosted sampling
- 1 March 2023
- journal article
- research article
- Published by IOP Publishing in Journal of Cosmology and Astroparticle Physics
- Vol. 2023 (03) , 059
Abstract
Forward modeling approaches in cosmology have made it possible to reconstruct the initial conditions at the beginning of the Universe from the observed survey data. However the high dimensionality of the parameter space still poses a challenge to explore the full posterior, with traditional algorithms such as Hamiltonian Monte Carlo (HMC) being computationally inefficient due to generating correlated samples and the performance of variational inference being highly dependent on the choice of divergence (loss) function. Here we develop a hybrid scheme, called variational self-boosted sampling (VBS) to mitigate the drawbacks of both these algorithms by learning a variational approximation for the proposal distribution of Monte Carlo sampling and combine it with HMC. The variational distribution is parameterized as a normalizing flow and learnt with samples generated on the fly, while proposals drawn from it reduce auto-correlation length in MCMC chains. Our normalizing flow uses Fourier space convolutions and element-wise operations to scale to high dimensions. We show that after a short initial warm-up and training phase, VBS generates better quality of samples than simple VI approaches and in the hybrid sampling phase, reduces the correlation length in the sampling phase by a factor of 10–50 over using only HMC to explore the posterior of initial conditions in 643 and 1283 dimensional problems, with larger gains for high signal-to-noise data observations. Hybrid sampling with online training of the variational distribution violates Markov property, and to retain the asymptotic guarantees of HMC, in the final phase we use a fixed variational distribution as proposal distribution and propagate these samples to the posterior distribution.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- Physical Bayesian modelling of the non-linear matter distribution: New insights into the nearby universeAstronomy & Astrophysics, 2019
- Cosmological reconstruction from galaxy light: neural network based light-matter connectionJournal of Cosmology and Astroparticle Physics, 2018
- Cosmology and fundamental physics with the Euclid satelliteLiving Reviews in Relativity, 2018
- Towards optimal extraction of cosmological information from nonlinear dataJournal of Cosmology and Astroparticle Physics, 2017
- Variational Inference: A Review for StatisticiansJournal of the American Statistical Association, 2017
- FastPM: a new scheme for fast simulations of dark matter and haloesMonthly Notices of the Royal Astronomical Society, 2016
- ELUCID—EXPLORING THE LOCAL UNIVERSE WITH THE RECONSTRUCTED INITIAL DENSITY FIELD. I. HAMILTONIAN MARKOV CHAIN MONTE CARLO METHOD WITH PARTICLE MESH DYNAMICSThe Astrophysical Journal, 2014
- Solving large scale structure in ten easy steps with COLAJournal of Cosmology and Astroparticle Physics, 2013
- Hybrid Monte CarloPhysics Letters B, 1987
- On Information and SufficiencyThe Annals of Mathematical Statistics, 1951