S cala E xtrap
Authors:
Open Access
- 1 April 2012
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Programming Languages and Systems
- Vol. 34 (1) , 1-29
Abstract
Performance modeling for scientific applications is important for assessing potential application performance and systems procurement in high-performance computing (HPC). Recent progress on communication tracing opens up novel opportunities for communication modeling due to its lossless yet scalable trace collection. Estimating the impact of scaling on communication efficiency still remains nontrivial due to execution-time variations and exposure to hardware and software artifacts. This work contributes a fundamentally novel modeling scheme. We synthetically generate the application trace for large numbers of nodes via extrapolation from a set of smaller traces. We devise an innovative approach for topology extrapolation of single program, multiple data (SPMD) codes with stencil or mesh communication. Experimental results show that the extrapolated traces precisely reflect the communication behavior and the performance characteristics at the target scale for both strong and weak scaling applications. The extrapolated trace can subsequently be (a) replayed to assess communication requirements before porting an application, (b) transformed to autogenerate communication benchmarks for various target platforms, and (c) analyzed to detect communication inefficiencies and scalability limitations. To the best of our knowledge, rapidly obtaining the communication behavior of parallel applications at arbitrary scale with the availability of timed replay, yet without actual execution of the application, at this scale, is without precedence and has the potential to enable otherwise infeasible system simulation at the exascale level.Keywords
Funding Information
- National Science Foundation (0937908 and 0958311)
This publication has 24 references indexed in Scilit:
- ScalaTrace: Scalable compression and replay of communication traces for high-performance computingJournal of Parallel and Distributed Computing, 2009
- Preserving time in large-scale communication traces2008
- Using MPI Communication Patterns to Guide Source Code Transformations2008
- Introducing the Open Trace Format (OTF)2006
- Performance Modeling: Understanding the Past and Predicting the Future2005
- Automatically characterizing large scale program behavior2002
- Performance and Scalability Analysis of Teraflop-Scale Parallel Architectures Using Multidimensional Wavefront ApplicationsThe International Journal of High Performance Computing Applications, 2000
- Analyzing scheduling policies using DimemasParallel Computing, 1997
- A high-performance, portable implementation of the MPI message passing interface standardParallel Computing, 1996
- The Nas Parallel BenchmarksThe International Journal of Supercomputing Applications, 1991