Open Access
- 3 March 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 22-31
Abstract
Performance optimization continues to be a challenge in modern HPC software. Existing performance optimization techniques, including profiling-based and auto-tuning techniques, fail to indicate program modifications at the source level thus preventing their portability across compilers. This paper describes Muppet, a new approach that identifies program modifications called mutations aimed at improving program performance. Muppet's mutations help developers reason about performance defects and missed opportunities to improve performance at the source code level. In contrast to compiler techniques that optimize code at intermediate representations (IR), Muppet uses the idea of source-level mutation testing to relax correctness constraints and automatically discover optimization opportunities that otherwise are not feasible using the IR. We demonstrate the Muppet's concept in the OpenMP programming model. Muppet generates a list of OpenMP mutations that alter the program parallelism in various ways, and is capable of running a variety of optimization algorithms such as Bayesian Optimization and delta debugging to find a subset of mutations which, when applied to the original program, cause the most speedup while maintaining program correctness. When Muppet is evaluated against a diverse set of benchmark programs and proxy applications, it is capable of finding sets of mutations in 70% of the evaluated programs that induce speedup.Keywords
Funding Information
- National Science Foundation (2119348)
- Department of Energy (DE-AC52-07NA27344, DE-SC0022182)
This publication has 45 references indexed in Scilit:
- Pattern-based Autotuning of OpenMP Loops using Graph Neural Networks2022
- The NAS Parallel Benchmarks for evaluating C++ parallel programming frameworks on shared-memory architecturesFuture Generation Computer Systems, 2021
- A Framework for Enabling OpenMP Autotuning2019
- GPUMixer: Performance-Driven Floating-Point Tuning for GPU Scientific Applications2019
- Mutomvo: Mutation testing framework for simulated cloud and HPC environmentsJournal of Systems and Software, 2018
- OMPT: An OpenMP Tools Application Programming Interface for Performance Analysis2013
- Statistical power modeling of GPU kernels using performance counters2010
- The Scalasca performance toolset architectureConcurrency and Computation: Practice and Experience, 2010
- Simplifying and isolating failure-inducing inputIEEE Transactions on Software Engineering, 2002
- Application of Bayesian approach to numerical methods of global and stochastic optimizationJournal of Global Optimization, 1994