Software engineering to sustain a high-performance computing scientific application: QMCPACK
Authors:
- William F. GodoyWGWilliam F. Godoy
- Steven E. HahnSHSteven E. Hahn
- Michael M. WalshMWMichael M. Walsh
- Philip W. FacklerPFPhilip W. Fackler
- Jaron T. KrogelJKJaron T. Krogel
- Peter W. DoakPDPeter W. Doak
- Paul R. C. KentPKPaul R. C. Kent
- Alfredo A. CorreaACAlfredo A. Correa
- Ye LuoYLYe Luo
- Mark DewingMDMark Dewing
Preprint
Abstract
We provide an overview of the software engineering efforts and their impact in QMCPACK, a production-level ab-initio Quantum Monte Carlo open-source code targeting high-performance computing (HPC) systems. Aspects included are: (i) strategic expansion of continuous integration (CI) targeting CPUs, using GitHub Actions runners, and NVIDIA and AMD GPUs in pre-exascale systems, using self-hosted hardware; (ii) incremental reduction of memory leaks using sanitizers, (iii) incorporation of Docker containers for CI and reproducibility, and (iv) refactoring efforts to improve maintainability, testing coverage, and memory lifetime management. We quantify the value of these improvements by providing metrics to illustrate the shift towards a predictive, rather than reactive, sustainable maintenance approach. Our goal, in documenting the impact of these efforts on QMCPACK, is to contribute to the body of knowledge on the importance of research software engineering (RSE) for the sustainability of community HPC codes and scientific discovery at scale.Keywords
All Related Versions
This publication has 19 references indexed in Scilit:
- Research Software Engineering at Oak Ridge National LaboratoryComputing in Science & Engineering, 2023
- Research Software Science: Expanding the Impact of Research Software EngineeringComputing in Science & Engineering, 2023
- For the Public Good: Connecting, Retaining, and Recognizing Current and Future RSEs at U.S. National Research Laboratories and AgenciesComputing in Science & Engineering, 2023
- A High-Performance Design for Hierarchical Parallelism in the QMCPACK Monte Carlo code2022
- How community software ecosystems can unlock the potential of exascale computingNature Computational Science, 2021
- QMCPACK: Advances in the development, efficiency, and application of auxiliary field and real-space variational and diffusion quantum Monte CarloThe Journal of Chemical Physics, 2020
- Exascale applications: skin in the gamePhilosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 2020
- Exascale Computing in the United StatesComputing in Science & Engineering, 2018
- Nexus: A modular workflow management system for quantum simulation codesComputer Physics Communications, 2016
- Quantum Monte Carlo simulations of solidsReviews of Modern Physics, 2001