Realizing Joint Extreme-Scale Simulations on Multiple Supercomputers—Two Superfacility Case Studies
- 17 November 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-17
Abstract
High-dimensional grid-based simulations serve as both a tool and a challenge in researching various domains. The main challenge of these approaches is the well-known curse of dimensionality, amplified by the need for fine resolutions in high-fidelity applications. The combination technique (CT) provides a straightforward way of performing such simulations while alleviating the curse of dimensionality. Recent work demonstrated the potential of the CT to join multiple systems simultaneously to perform a single high-dimensional simulation. This paper shows how to extend this to three or more systems and addresses some remaining challenges: load balancing on heterogeneous hardware; utilizing compression to maximize the communication bandwidth; efficient I/O management through hardware mapping; and improving memory utilization through algorithmic optimizations. Combining these contributions, we demonstrate the feasibility of the CT for extreme-scale Superfacility scenarios of 46 trillion DOF on two systems and 35 trillion DOF on three systems. Scenarios at these resolutions would be intractable with full-grid solvers ($\gt1,000$ nonillion DOF each).Keywords
This publication has 32 references indexed in Scilit:
- A high resolution Physics-informed neural networks for high-dimensional convection–diffusion–reaction equationsApplied Soft Computing, 2023
- The Deep Learning Galerkin Method for the General Stokes EquationsJournal of Scientific Computing, 2022
- A Comprehensive Deep Learning-Based Approach to Reduced Order Modeling of Nonlinear Time-Dependent Parametrized PDEsJournal of Scientific Computing, 2021
- Solving High-Dimensional Dynamic Portfolio Choice Models with Hierarchical B-Splines on Sparse GridsComputational Economics, 2021
- EXAHD: A Massively Parallel Fault Tolerant Sparse Grid Approach for High-Dimensional Turbulent Plasma Simulations2020
- TerraNeo—Mantle Convection Beyond a Trillion Degrees of Freedom2020
- Comparing Nested Sequences of Leja and PseudoGauss Points to Interpolate in 1D and Solve the Schroedinger Equation in 9D2018
- Adaptive Sparse Grids and Extrapolation Techniques2016
- Sparse Grids in a Nutshell2012
- An extension to MPI for distributed computing on MPPs1997