KLAP: Kernel launch aggregation and promotion for optimizing dynamic parallelism
- 1 October 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-12
Abstract
Dynamic parallelism on GPUs simplifies the programming of many classes of applications that generate paral-lelizable work not known prior to execution. However, modern GPUs architectures do not support dynamic parallelism efficiently due to the high kernel launch overhead, limited number of simultaneous kernels, and limited depth of dynamic calls a device can support. In this paper, we propose Kernel Launch Aggregation and Promotion (KLAP), a set of compiler techniques that improve the performance of kernels which use dynamic parallelism. Kernel launch aggregation fuses kernels launched by threads in the same warp, block, or kernel into a single aggregated kernel, thereby reducing the total number of kernels spawned and increasing the amount of work per kernel to improve occupancy. Kernel launch promotion enables early launch of child kernels to extract more parallelism between parents and children, and to aggregate kernel launches across generations mitigating the problem of limited depth. We implement our techniques in a real compiler and show that kernel launch aggregation obtains a geometric mean speedup of 6.58x over regular dynamic parallelism. We also show that kernel launch promotion enables cases that were not originally possible, improving throughput by a geometric mean of 30.44 x.Keywords
This publication has 22 references indexed in Scilit:
- Dynamic parallelism for simple and efficient GPU graph algorithms2015
- Dynamic thread block launch2015
- Efficient execution of recursive programs on commodity vector hardware2015
- NUPAR2015
- pocl: A Performance-Portable OpenCL ImplementationInternational Journal of Parallel Programming, 2014
- Efficient GPU-Implementation of Adaptive Mesh Refinement for the Shallow-Water EquationsJournal of Scientific Computing, 2014
- CUDA-NPACM SIGPLAN Notices, 2014
- StreamScan2013
- Kernel Weaver: Automatically Fusing Database Primitives for Efficient GPU Computation2012
- Efficient stream compaction on wide SIMD many-core architectures2009