Safe limits on voltage reduction efficiency in GPUs
Authors:
Open Access
- 5 December 2015
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 294-307
Abstract
Energy efficiency of GPU architectures has emerged as an important aspect of computer system design. In this paper, we explore the energy benefits of reducing the GPU chip's voltage to the safe limit, i.e. Vmin point. We perform such a study on several commercial off-the-shelf GPU cards. We find that there exists about 20% voltage guardband on those GPUs spanning two architectural generations, which, if "eliminated" completely, can result in up to 25% energy savings on one of the studied GPU cards. The exact improvement magnitude depends on the program's available guardband, because our measurement results unveil a program dependent Vmin behavior across the studied programs. We make fundamental observations about the program-dependent Vmin behavior. We experimentally determine that the voltage noise has a larger impact on Vmin compared to the process and temperature variation, and the activities during the kernel execution cause large voltage droops. From these findings, we show how to use a kernel's microarchitectural performance counters to predict its Vmin value accurately. The average and maximum prediction errors are 0.5% and 3%, respectively. The accurate Vmin prediction opens up new possibilities of a cross-layer dynamic guardbanding scheme for GPUs, in which software predicts and manages the voltage guardband, while the functional correctness is ensured by a hardware safety net mechanism.Keywords
Funding Information
- National Science Foundation (CCF-1218474)
- Defense Advanced Research Projects Agency (HR0011-13-C-0022)
This publication has 32 references indexed in Scilit:
- Long-term NBTI degradation under real-use conditions in IBM microprocessorsMicroelectronics Reliability, 2014
- GPUVolt2014
- A locality-aware memory hierarchy for energy-efficient GPU architectures2013
- GPUWattch2013
- VRSyncACM SIGARCH Computer Architecture News, 2012
- Active management of timing guardband to save energy in POWER72011
- Where Do the Dopants Go?Science, 2005
- Statistical Parameter Extraction for Intra- and Inter-Chip Variabilities of Metal–Oxide–Semiconductor Field-Effect Transistor CharacteristicsJapanese Journal of Applied Physics, 2005
- Characterization of Spatial Intrafield Gate CD Variability, Its Impact on Circuit Performance, and Spatial Mask-Level CorrectionIEEE Transactions on Semiconductor Manufacturing, 2004
- Pipeline muffling and a priori current ramping2003