Extreme data compression for Bayesian model comparison
Open Access
- 1 November 2023
- journal article
- research article
- Published by IOP Publishing in Journal of Cosmology and Astroparticle Physics
- Vol. 2023 (11)
Abstract
We develop extreme data compression for use in Bayesian model comparison via the MOPED algorithm, as well as more general score compression. We find that Bayes Factors from data compressed with the MOPED algorithm are identical to those from their uncompressed datasets when the models are linear and the errors Gaussian. In other nonlinear cases, whether nested or not, we find negligible differences in the Bayes Factors, and show this explicitly for the Pantheon-SH0ES supernova dataset. We also investigate the sampling properties of the Bayesian Evidence as a frequentist statistic, and find that extreme data compression reduces the sampling variance of the Evidence, but has no impact on the sampling distribution of Bayes Factors. Since model comparison can be a very computationally-intensive task, MOPED extreme data compression may present significant advantages in computational time.Keywords
All Related Versions
This publication has 38 references indexed in Scilit:
- An investigation into the Multiple Optimised Parameter Estimation and Data compression algorithmMonthly Notices of the Royal Astronomical Society: Letters, 2011
- The power of Bayesian evidence in astronomyMonthly Notices of the Royal Astronomical Society, 2011
- The cosmic evolution of metallicity from the SDSS fossil recordMonthly Notices of the Royal Astronomical Society, 2008
- Bayes in the sky: Bayesian inference and model selection in cosmologyContemporary Physics, 2008
- The star formation histories of galaxies in the Sloan Digital Sky SurveyMonthly Notices of the Royal Astronomical Society, 2007
- The star-formation history of the Universe from the stellar populations of nearby galaxiesNature, 2004
- Star formation and metallicity history of the SDSS galaxy survey: unlocking the fossil recordMonthly Notices of the Royal Astronomical Society, 2003
- Fast parameter estimation from the cosmic microwave background power spectrumMonthly Notices of the Royal Astronomical Society, 2002
- Massive lossless data compression and multiple parameter estimation from galaxy spectraMonthly Notices of the Royal Astronomical Society, 2000
- Karhunen‐Loeve Eigenvalue Problems in Cosmology: How Should We Tackle Large Data Sets?The Astrophysical Journal, 1997