DAME: Runtime-compilation for data movement
Authors:
- 18 April 2017
- journal article
- conference paper
- Published by SAGE Publications in The International Journal of High Performance Computing Applications
- Vol. 32 (5) , 760-774
Abstract
Modern machines consist of multiple compute devices and complex memory hierarchies. For many applications, it is imperative that any data movement between and within the various compute devices be done as efficiently as possible in order to obtain maximum performance. However, hand-optimizing code for one architecture will likely sacrifice both performance portability and software maintainability. In addition, some optimization decisions are best made at runtime. This suggests that the problem ought to be tackled on two fronts. First, provide the programmer with a declarative language to describe data layouts and data motion. This would allow the runtime system to be tuned for each architecture by a specialist and free the programmer to concentrate on the application itself. Second, exploit the execution time information to optimize the data movement code further. MPI derived datatypes accomplish the former task and Just In Time (JIT) compilation can be used for the latter. In this paper, we present DAME—a language and interpreter designed to be used as the backend for MPI derived datatypes. We also present DAME-L and DAME-X, two JIT-enabled implementations of DAME, all of which have been integrated into MPICH. We evaluate their performance on DDTBench and two mini-applications written with MPI derived datatypes and obtain communication speedups of up to 20× and mini-application speedups of up to 3×.Keywords
Funding Information
- National Nuclear Security Administration (DE-NA0002374)
This publication has 17 references indexed in Scilit:
- DAME2015
- HOPE: A Python just-in-time compiler for astrophysical computationsAstronomy and Computing, 2015
- On fast parallel detection of strongly connected components (SCC) in small-world graphs2013
- MPI datatype processing using runtime compilation2013
- Parallel Zero-Copy Algorithms for Fast Fourier Transform and Conjugate Gradient Using MPI Datatypes2010
- Trace-based just-in-time type specialization for dynamic languagesACM SIGPLAN Notices, 2009
- Automatic Memory Optimizations for Improving MPI Derived Datatype Performance2006
- Implementing Fast and Reusable Datatype Processing2003
- Compiling Java just in timeIEEE Micro, 1997
- Advanced compiler optimizations for supercomputersCommunications of the ACM, 1986