STAPL-RTS
Open Access
- 8 June 2015
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 425-434
Abstract
Modern HPC systems are growing in complexity, as they move towards deeper memory hierarchies and increasing use of computational heterogeneity via GPUs or other accelerators. When developing applications for these platforms, programmers are faced with two bad choices. On one hand, they can explicitly manage all machine resources, writing programs decorated with low level primitives from multiple APIs (e.g. Hybrid MPI / OpenMP applications). Though seemingly necessary for efficient execution, it is an inherently non-scalable way to write software. Without a separation of concerns, only small programs written by expert developers actually achieve this efficiency. Furthermore, the implementations are rigid, difficult to extend, and not portable. Alternatively, users can adopt higher level programming environments to abstract away these concerns. Extensibility and portability, however, often come at the cost of lost performance. The mapping of a user's application onto the system now occurs without the contextual information that was immediately available in the more coupled approach. In this paper, we describe a framework for the transfer of high level, application semantic knowledge into lower levels of the software stack at an appropriate level of abstraction. Using the STAPL library, we demonstrate how this information guides important decisions in the runtime system (STAPL-RTS), such as multi-protocol communication coordination and request aggregation. Through examples, we show how generic programming idioms already known to C++ programmers are used to annotate calls and increase performance.Keywords
Funding Information
- King Abdullah University of Science and Technology (KUS-C1-016-04)
- National Institutes of Health (CA090301-11)
- National Science Foundation (CNS-0551685, CCF 0702765, CCF-0833199,CCF-1439145,CCF-1423111,CCF-0830753, IIS-0916053, IIS-0917266, EFRI-1240483, RI-1217991)
- U.S. Department of Energy (DE-AC02-06CH11357,DE-NA0002376,B575363)
This publication has 31 references indexed in Scilit:
- The STAPL Parallel Graph LibraryLecture Notes in Computer Science, 2013
- The STAPL parallel container frameworkACM SIGPLAN Notices, 2011
- Test suite for evaluating performance of multithreaded MPI communicationParallel Computing, 2009
- K-Means2009
- The Tau Parallel Performance SystemThe International Journal of High Performance Computing Applications, 2006
- Immutability specification and its applicationsConcurrency and Computation: Practice and Experience, 2005
- Problems with using MPI 1.1 and 2.0 as compilation targets for parallel language implementationsInternational Journal of High Performance Computing and Networking, 2004
- TreadMarks: shared memory computing on networks of workstationsComputer, 1996
- CHARM++ACM SIGPLAN Notices, 1993
- The incremental garbage collection of processesACM SIGPLAN Notices, 1977