CosmoUiT: A Vision Transformer-UNet Hybrid for Fast and Accurate Emulation of 21-cm Maps from the Epoch of Reionization
Preprint
Abstract
The observation of the redshifted 21-cm signal from the intergalactic medium will probe the epoch of reionization (EoR) with unprecedented detail. Various simulations are being developed and used to predict and understand the nature and morphology of this signal. However, these simulations are computationally very expensive and time-consuming to produce in large numbers. To overcome this problem, an efficient field-level emulator of this signal is required. However, the EoR 21-cm signal is highly non-Gaussian; therefore, capturing the correlations between different scales of this signal, which is directly related to the evolution of the reionization, with the neural network is quite difficult. Here, we introduce CosmoUiT, a UNet integrated vision transformer-based architecture, to overcome these difficulties. CosmoUiT emulates the 3D cubes of 21-cm signal from the EoR, for a given input dark matter density field, halo density field, and reionization parameters. CosmoUiT uses the multi-head self-attention mechanism of the transformer to capture the long-range dependencies and convolutional layers in the UNet to capture the small-scale variations in the target 21-cm field. Furthermore, the training of the emulator is conditioned on the input reionization parameters such that it gives a fast and accurate prediction of the 21-cm field for different sets of input reionization parameters. We evaluate the predictions of our emulator by comparing various statistics (e.g., bubble size distribution, power spectrum) and morphological features of the emulated and simulated maps. We further demonstrate that this vision transformer-based architecture can emulate the entire 3D 21-cm signal cube with high accuracy at both large and small scales.Keywords
All Related Versions
This publication has 54 references indexed in Scilit:
- Deeper multi-redshift upper limits on the epoch of reionisation 21 cm signal power spectrum from LOFAR between z = 8.3 and z = 10.1Astronomy & Astrophysics, 2025
- Planck2018 resultsAstronomy & Astrophysics, 2020
- Planckintermediate resultsAstronomy & Astrophysics, 2016
- STATISTICS OF 207 Lyα EMITTERS AT A REDSHIFT NEAR 7: CONSTRAINTS ON REIONIZATION AND GALAXY FORMATION MODELSThe Astrophysical Journal, 2010
- Efficient Simulations of Early Structure Formation and ReionizationThe Astrophysical Journal, 2007
- Cosmology at low frequencies: The 21cm transition and the high-redshift UniversePhysics Reports, 2006
- Constraining the Evolution of the Ionizing Background and the Epoch of Reionization withz ~ 6 Quasars. II. A Sample of 19 QuasarsThe Astronomical Journal, 2006
- The Growth of HiiRegions During ReionizationThe Astrophysical Journal, 2004
- HI fluctuations at large redshifts: III — Simulating the signal expected at GMRTJournal of Astrophysics and Astronomy, 2004
- The evolution of large-scale structure in a universe dominated by cold dark matterThe Astrophysical Journal, 1985