Maximizing the GPU resource usage by reordering concurrent kernels submission
- 17 January 2018
- journal article
- research article
- Published by Wiley in Concurrency and Computation: Practice and Experience
- Vol. 31 (18)
Abstract
Summary: The increasing amount of resources available on current GPUs sparked new interest in the problem of sharing its resources by different kernels. While new generations of GPUs support concurrent kernel execution, their scheduling decisions are taken by the hardware at runtime. The hardware decisions, however, heavily depend on the order at which the kernels are submitted to execution. In this work, we propose a novel optimization approach to reorder the kernels invocation focusing on maximizing the resources utilization, improving the average turnaround time. We model the kernel assignments to the hardware resources as a series of knapsack problems and use a dynamic programming approach to solve them. We evaluate our method using kernels with different sizes and resource requirements. Our results show significant gains in the average turnaround time and system throughput compared to the kernels submission implemented in modern GPUs.Keywords
Funding Information
- Conselho Nacional de Desenvolvimento Científico e Tecnológico
- Coordenação de Aperfeiçoamento de Pessoal de Nível Superior
- Fundação Sociedade Brasileira de Pediatria
This publication has 18 references indexed in Scilit:
- Chimera2015
- Enabling preemptive multiprogramming on GPUsACM SIGARCH Computer Architecture News, 2014
- Kernelet: High-Throughput GPU Kernel Executions with Dynamic Slicing and SchedulingIEEE Transactions on Parallel and Distributed Systems, 2013
- Increasing GPU throughput using kernel interleaved thread block scheduling2013
- Improving GPGPU concurrency with elastic kernelsACM SIGPLAN Notices, 2013
- An efficient scheduling scheme using estimated execution time for heterogeneous computing systemsThe Journal of Supercomputing, 2013
- On Improving the Performance of Multi-threaded CUDA Applications with Concurrent Kernel Execution by Kernel Reordering2012
- The case for GPGPU spatial multitasking2012
- Exploiting concurrent kernel execution on graphic processing units2011
- The Scalable Heterogeneous Computing (SHOC) benchmark suite2010