Ensemble Simulations on Leadership Computing Systems
Authors:
- 17 November 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 394-401
Abstract
Scientific productivity can be enhanced through workflow management tools, relieving large High Performance Computing (HPC) system users from the tedious tasks of scheduling and designing the complex computational execution of scientific applications. This paper presents a study on the usage of ensemble workflow tools to accelerate science using the Summit and Frontier supercomputing systems. The research aims to connect science domain simulations using Oak Ridge Leadership Computing Facility (OLCF) supercomputing platforms with ensemble workflow methods in order to accelerate HPC-enabled discovery and boost scientific impact. We present the coupling, porting and optimization of Radical-Cybertools on three applications: Chroma, NAMD and LAMMPS. The tools augment traditional HPC monolithic runs with a pilot scheduler. Lessons-learned are discussed for physics, biology and materials science applications. We discuss intrinsic limitations of coupling and porting ensemble workflow tools to applications that run on large HPC systems. The origins of technical challenges and their solutions developed during the implementation process are discussed. Data management strategies, OLCF’s policies for ensembles, and natively supported workflow tools are also summarized. 1Keywords
Funding Information
- Office of Science
This publication has 36 references indexed in Scilit:
- Studying performance portability of LAMMPS across diverse GPU‐based platformsConcurrency and Computation: Practice and Experience, 2023
- Order Parameter Engineering for Random SystemsHigh Entropy Alloys & Materials, 2023
- Exploiting Machine Learning in Multiscale Modelling of MaterialsJournal of The Institution of Engineers (India): Series D, 2022
- Three practical workflow schedulers for easy maximum parallelismSoftware: Practice and Experience, 2021
- Influence of thermomechanical loads on the energetics of precipitation in magnesium aluminum alloysActa Materialia, 2020
- ASKALON: A Development and Grid Computing Environment for Scientific Workflows2007
- Scalable molecular dynamics with NAMDJournal of Computational Chemistry, 2005
- Nanostructured High‐Entropy Alloys with Multiple Principal Elements: Novel Alloy Design Concepts and OutcomesAdvanced Engineering Materials, 2004
- NAMD2: Greater Scalability for Parallel Molecular DynamicsJournal of Computational Physics, 1999
- Monte Carlo Methods1964