Characterizing and Improving the Performance of Many-Core Task-Based Parallel Programming Runtimes
- 1 May 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1285-1292
Abstract
Parallel task-based programming models like OpenMP support the declaration of task data dependences. This information is used to delay the task execution until the task data is available. The dependences between tasks are calculated at runtime using shared graphs that are updated concurrently by all threads. However, only one thread can modify the task graph at a time to ensure correctness; others need to wait before doing their modifications. This waiting limits the application's parallelism and becomes critical in many-core systems. This paper characterizes this behavior, analyzing how it hinders performance and presenting an alternative organization suitable for the runtimes of task-based programming models. This organization allows managing the runtime structures asynchronously or synchronously, adapting the runtime to reduce the waste of computation resources and increase theperformance. Results show that the new runtime structure outperforms the peak speedup of the original runtime model whencontention is huge and achieves similar or better performance results for real applications.Keywords
This publication has 12 references indexed in Scilit:
- Asynchronous Runtimes in Action: An Introspective Framework for a Next Gen Runtime2016
- Nexus#: A Distributed Hardware Task Manager for Task-Based Programming Models2015
- TurboBŁYSK: Scheduling for Improved Data-Driven Task Performance with Fast Dependency ResolutionLecture Notes in Computer Science, 2014
- Hybrid Dataflow/von-Neumann ArchitecturesIEEE Transactions on Parallel and Distributed Systems, 2013
- Optimizing communication for Charm++ applications by reducing network contentionConcurrency and Computation: Practice and Experience, 2010
- OpenCL: A Parallel Programming Standard for Heterogeneous Computing SystemsComputing in Science & Engineering, 2010
- Hierarchical Task-Based Programming With StarSsThe International Journal of High Performance Computing Applications, 2009
- Characterizing and improving the performance of Intel Threading Building Blocks2008
- MapReduceCommunications of the ACM, 2008
- OpenMP: an industry standard API for shared-memory programmingIEEE Computational Science and Engineering, 1998