Impacts and Statistical Mitigation of Missing Data on the 21 cm Power Spectrum: A Case Study with the Hydrogen Epoch of Reionization Array
Authors:
- Kai-Feng ChenKCKai-Feng Chen
- Michael J. WilenskyMWMichael J. Wilensky
- Adrian LiuALAdrian Liu
- Joshua S. DillonJDJoshua S. Dillon
- Jacqueline N. HewittJHJacqueline N. Hewitt
- James E. AguirreJAJames E. Aguirre
- Adam P. BeardsleyABAdam P. Beardsley
- Lindsay M. BerkhoutLBLindsay M. Berkhout
- Gianni BernardiGBGianni Bernardi
Open Access
- 27 January 2025
- journal article
- research article
- Published by American Astronomical Society in The Astrophysical Journal
- Vol. 979 (2) , 191
Abstract
The precise characterization and mitigation of systematic effects is one of the biggest roadblocks impeding the detection of the fluctuations of cosmological 21 cm signals. Missing data in radio cosmological experiments, often due to radio frequency interference (RFI), pose a particular challenge to power spectrum analysis as this could lead to the ringing of bright foreground modes in the Fourier space, heavily contaminating the cosmological signals. Here we show that the problem of missing data becomes even more arduous in the presence of systematic effects. Using a realistic numerical simulation, we demonstrate that partially flagged data combined with systematic effects can introduce significant foreground ringing. We show that such an effect can be mitigated through inpainting the missing data. We present a rigorous statistical framework that incorporates the process of inpainting missing data into a quadratic estimator of the 21 cm power spectrum. Under this framework, the uncertainties associated with our inpainting method and its impact on power spectrum statistics can be understood. These results are applied to the latest Phase II observations taken by the Hydrogen Epoch of Reionization Array, forming a crucial component in power spectrum analyses as we move toward detecting 21 cm signals in the ever more noisy RFI environment.Keywords
All Related Versions
Funding Information
- National Science Foundation (1636646)
- National Science Foundation (1836019)
- Gordon and Betty Moore Foundation (GBMF5215)
This publication has 122 references indexed in Scilit:
- Survey and monitoring of ASKAP’s RFI environment and trends I: Flagging statisticsPublications of the Astronomical Society of Australia, 2024
- GaLactic and Extragalactic All-sky Murchison Widefield Array (GLEAM) survey II: Galactic plane 345° <l< 67°, 180° <l< 240°Publications of the Astronomical Society of Australia, 2019
- The Phase II Murchison Widefield Array: Design overviewPublications of the Astronomical Society of Australia, 2018
- The Low-Frequency Environment of the Murchison Widefield Array: Radio-Frequency Interference Analysis and MitigationPublications of the Astronomical Society of Australia, 2015
- The Murchison Widefield Array: The Square Kilometre Array Precursor at Low Radio FrequenciesPublications of the Astronomical Society of Australia, 2013
- CMB data analysis and sparsityStatistical Methodology, 2008
- Cosmology at low frequencies: The 21cm transition and the high-redshift UniversePhysics Reports, 2006
- Least-squares frequency analysis of unequally spaced dataAstrophysics and Space Science, 1976
- Further development and properties of the spectral analysis by least-squaresAstrophysics and Space Science, 1971
- Approximate spectral analysis by least-squares fitAstrophysics and Space Science, 1969