Dynamic warp formation
Authors:
Open Access
- 1 June 2009
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Architecture and Code Optimization
- Vol. 6 (2) , 1-37
Abstract
Recent advances in graphics processing units (GPUs) have resulted in massively parallel hardware that is easily programmable and widely available in today's desktop and notebook computer systems. GPUs typically use single-instruction, multiple-data (SIMD) pipelines to achieve high performance with minimal overhead for control hardware. Scalar threads running the same computing kernel are grouped together into SIMD batches, sometimes referred to as warps. While SIMD is ideally suited for simple programs, recent GPUs include control flow instructions in the GPU instruction set architecture and programs using these instructions may experience reduced performance due to the way branch execution is supported in hardware. One solution is to add a stack to allow different SIMD processing elements to execute distinct program paths after a branch instruction. The occurrence of diverging branch outcomes for different processing elements significantly degrades performance using this approach. In this article, we propose dynamic warp formation and scheduling, a mechanism for more efficient SIMD branch execution on GPUs. It dynamically regroups threads into new warps on the fly following the occurrence of diverging branch outcomes. We show that a realistic hardware implementation of this mechanism improves performance by 13%, on average, with 256 threads per core, 24% with 512 threads, and 47% with 768 threads for an estimated area increase of 8%.Keywords
This publication has 28 references indexed in Scilit:
- Concurrent number cruncher: a GPU implementation of a general sparse linear solverInternational Journal of Parallel, Emergent and Distributed Systems, 2009
- RPUACM Transactions on Graphics, 2005
- The GeForce 6800IEEE Micro, 2005
- A flexible simulation framework for graphics architectures2004
- Ray tracing on programmable graphics hardware2002
- A user-programmable vertex engine2001
- The SimpleScalar tool set, version 2.0ACM SIGARCH Computer Architecture News, 1997
- Simulation of wrinkled surfacesACM SIGGRAPH Computer Graphics, 1978
- Shadow algorithms for computer graphicsACM SIGGRAPH Computer Graphics, 1977
- A general method applicable to the search for similarities in the amino acid sequence of two proteinsJournal of Molecular Biology, 1970