STORM: RDMA-based Monte Carlo Transport Scheme for Distributed-memory Particle Simulations
Open Access
- 29 September 2026
- journal article
- Published by American Astronomical Society in The Astrophysical Journal Supplement Series
- Vol. 286 (2) , 67
Abstract
Monte Carlo particle transport enables high-fidelity astrophysical radiation and neutrino simulations—from core-collapse supernovae and neutron-star mergers to accretion flows—by handling multidimensional geometries, frequency dependence, and moving media without angular discretization. However, inter-rank communication limits scalability on unstructured meshes: standard two-sided MPI requires receivers to post “receives” and “poll” completions, creating per-iteration progress overhead that grows with the number of communication partners. Such problems have not demonstrated high scaling efficiency at O (10 4 ) cores. We present STORM (Scalable Transport via One-sided Remote Memory), an open-source library for Monte Carlo transport on general meshes, physics, and boundary conditions. STORM provides a lock-free, mesh-independent communication layer that replaces MPI’s matched-send/receive semantics with remote direct memory access (RDMA)—one-sided operations that write directly into a remote rank’s memory without involving its CPU. Each rank pair shares a single-producer, single-consumer ring buffer; RDMA writes transfer particles while receivers remain passive. A two-sided MPI backend provides a portable fallback. In an adversarial uniform-emission benchmark, the RDMA backend sustains >97% weak-scaling and >88% work-preserving scaling efficiency up to 13,440 cores (112 cores per network adapter), with 1.14–1.27× speedups over the two-sided alternative. In a Hohlraum IMC benchmark at 4480 ranks, it is 1.41× faster because MPI progress overhead is reduced by 6.1×. By decoupling communication from physics models and mesh representations, STORM removes a barrier to scaling Monte Carlo transport in astrophysical multiphysics codes, enabling coupled radiation-hydrodynamics with energy- and angle-resolved photon or neutrino transport on dynamically evolving meshes at scale.Keywords
All Related Versions
Funding Information
- European High Performance Computing Joint Undertaking (EHPC-DEV-2026D04-204)
This publication has 24 references indexed in Scilit:
- Neutrino transport in general relativistic neutron star merger simulationsLiving Reviews in Computational Astrophysics, 2023
- Physical, numerical, and computational challenges of modeling neutrino transport in core-collapse supernovaeLiving Reviews in Computational Astrophysics, 2020
- Monte Carlo radiative transferLiving Reviews in Computational Astrophysics, 2019
- The TORUS radiation transfer codeAstronomy and Computing, 2019
- A hybrid transport-diffusion Monte Carlo method for frequency-dependent radiative-transfer simulationsJournal of Computational Physics, 2012
- A modified implicit Monte Carlo method for time-dependent radiative transfer with adaptive material couplingJournal of Computational Physics, 2009
- An efficient, robust, domain-decomposition algorithm for particle Monte CarloJournal of Computational Physics, 2009
- A hybrid transport-diffusion method for Monte Carlo radiative-transfer simulationsJournal of Computational Physics, 2007
- A random walk procedure for improving the computational efficiency of the implicit Monte Carlo method for nonlinear radiation transportJournal of Computational Physics, 1984
- An implicit Monte Carlo scheme for calculating time and frequency dependent nonlinear radiation transportJournal of Computational Physics, 1971