Scratch That (But Cache This): A Hybrid Register Cache/Scratchpad for GPUs
- 19 July 2018
- journal article
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
- Vol. 37 (11) , 2779-2789
Abstract
Graphics processing units (GPUs) are throughput-oriented architectures that implement massive multi-threading. Large, power-hungry register files are required in GPUs to support the simultaneous execution of thousands of threads on the hardware. Prior work proposed reducing register access energy by adding a small register cache to the GPU. The cache stores recently referenced registers and services subsequent accesses to these registers, reducing accesses to the main register file. Later work obtained further energy savings by replacing this cache with a compiler-managed scratchpad. We note that registers are allocated to the cache dynamically and reactively whereas registers are allocated to the scratchpad statically and proactively. Our insight is that these allocation schemes are complimentary because the cache leverages runtime information unavailable to the compiler and the scratchpad leverages compile time information unavailable to the cache. Further, there exist register access patterns that are easily captured by one structure but for which the other structure is ineffective. Instead of implementing either a register cache or scratchpad alone, we propose dividing temporary register storage capacity between a cache and a scratchpad in order to capture a broader range of register accesses. Given 12 KB of storage per streaming multiprocessor, our hybrid design reduces register energy to 38.7% of the baseline, compared to 47.9% for a register cache and 47.1% for a register scratchpad.Keywords
Funding Information
- Arm, Ltd.
- National Science Foundation (XPS-1438996, SHF-1527301)
This publication has 18 references indexed in Scilit:
- G-Scalar: Cost-Effective Generalized Scalar Execution Architecture for Power-Efficient GPUs2017
- Pilot Register File: Energy Efficient Partitioned Register File for GPUs2017
- Zorua: A holistic approach to resource virtualization in GPUs2016
- GPU register file virtualization2015
- Warped-compression2015
- GPUWattch2013
- Exploiting uniform vector instructions for GPGPU performance, energy efficiency, and opportunistic reliability enhancement2013
- Warped register file: A power efficient register file for GPGPUs2013
- Power-performance co-optimization of throughput core architecture using resistive memory2013
- A compile-time managed multi-level register file hierarchy2011