Nested sampling cross-checks using order statistics
Authors:
- Andrew FowlieAFAndrew Fowlie
- Will HandleyWHWill Handley
- Liangliang SuLSLiangliang Su
Preprint
Abstract
Nested sampling (NS) is an invaluable tool in data analysis in modern astrophysics, cosmology, gravitational wave astronomy and particle physics. We identify a previously unused property of NS related to order statistics: the insertion indexes of new live points into the existing live points should be uniformly distributed. This observation enabled us to create a novel cross-check of single NS runs. The tests can detect when an NS run failed to sample new live points from the constrained prior and plateaus in the likelihood function, which break an assumption of NS and thus leads to unreliable results. We applied our cross-check to NS runs on toy functions with known analytic results in 2 - 50 dimensions, showing that our approach can detect problematic runs on a variety of likelihoods, settings and dimensions. As an example of a realistic application, we cross-checked NS runs performed in the context of cosmological model selection. Since the cross-check is simple, we recommend that it become a mandatory test for every applicable NS run.Keywords
All Related Versions
This publication has 46 references indexed in Scilit:
- SciPy 1.0: fundamental algorithms for scientific computing in PythonNature Methods, 2020
- A statistical test for Nested Sampling algorithmsStatistics and Computing, 2014
- X-ray spectral modelling of the AGN obscuring region in the CDFS: Bayesian model selection and catalogueAstronomy & Astrophysics, 2014
- Nested sampling in the canonical ensemble: Direct calculation of the partition function from NVT trajectoriesThe Journal of Chemical Physics, 2013
- CONSTRAINTS ON COSMIC-RAY PROPAGATION MODELS FROM A GLOBAL BAYESIAN ANALYSISThe Astrophysical Journal, 2011
- Efficient Sampling of Atomic Configurational SpacesThe Journal of Physical Chemistry B, 2010
- Bayesian selection of sign μ within mSUGRA in global fits including WMAP5 resultsJournal of High Energy Physics, 2008
- A Nested Sampling Algorithm for Cosmological Model SelectionThe Astrophysical Journal, 2006
- Nested SamplingAIP Conference Proceedings, 2004
- Bayes FactorsJournal of the American Statistical Association, 1995