Characterization of Large-scale HPC Workloads with non-naïve I/O Roofline Modeling and Scoring
Authors:
- 17 December 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 737-744
Abstract
This paper introduces a novel approach to characterize system and application performance in high performance computing (HPC) systems. Traditional metrics such as computations and memory accesses alone are no longer sufficient to evaluate the performance of such systems. To address this challenge, an empirical I/O Roofline model and corresponding workload analysis workflow are proposed that can be adapted in the future to enable multidimensional evaluation for application performance characterization across different HPC systems. The model focuses on commonly used performance metrics such as I/O operations per second (IOPS) and I/O bandwidth, and leverages the well-known Roofline modeling technique to intuitively characterize I/O performance and identify performance bottlenecks without requiring deep knowledge of the I/O stack. Furthermore, based on the I/O Roofline model, a scoring approach is described that provides a unified and comprehensible method for evaluating the performance of different systems and applications. The effectiveness of the approach is demonstrated by evaluating the performance of various application I/O kernels using the empirical Roofline model.Keywords
This publication has 25 references indexed in Scilit:
- A Comprehensive I/O Knowledge Cycle for Modular and Automated HPC Workload Analysis2022
- Bridging Network and Parallel I/O Research for Improving Data-Intensive Distributed Applications2021
- Parallel I/O Evaluation Techniques and Emerging HPC Workloads: A Perspective2021
- DLIO: A Data-Centric Benchmark for Scientific Deep Learning Applications2021
- tf-Darshan: Understanding Fine-grained I/O Performance in Machine Learning Workloads2020
- Vidya: Performing Code-Block I/O Characterization for Data Access Optimization2018
- Performance Modeling and Design of Computer Systems2013
- Software Performance and Scalability2008
- Lattice Boltzmann simulation optimization on leading multicore platforms2008
- The LINPACK Benchmark: past, present and futureConcurrency and Computation: Practice and Experience, 2003