GPU Static Modeling Using PTX and Deep Structured Learning
Open Access
- 4 November 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 7, 159150-159161
Abstract
In the quest for exascale computing, energy-efficiency is a fundamental goal in high-performance computing systems, typically achieved via dynamic voltage and frequency scaling (DVFS). However, this type of mechanism relies on having accurate methods of predicting the performance and power/energy consumption of such systems. Unlike previous works in the literature, this research focuses on creating novel GPU predictive models that do not require run-time information from the applications. The proposed models, implemented using recurrent neural networks, take into account the sequence of GPU assembly instructions (PTX) and can accurately predict changes in the execution time, power and energy consumption of applications when the frequencies of different GPU domains (core and memory) are scaled. Validated with 24 applications on GPUs from different NVIDIA microarchitectures (Turing, Volta, Pascal and Maxwell), the proposed models attain a significant accuracy. Particularly, the obtained power consumption scaling model provides an average error rate of 7.9% (Tesla T4), 6.7% (Titan V), 5.9% (Titan Xp) and 5.4% (GTX Titan X), which is comparable to state-of-the-art run-time counter-based models. When using the models to select the minimum-energy frequency configuration, significant energy savings can be attained: 8.0% (Tesla T4), 6.0% (Titan V), 29.0% (Titan Xp) and 11.5% (GTX Titan X).Keywords
This publication has 32 references indexed in Scilit:
- A survey and measurement study of GPU DVFS on energy conservationDigital Communications and Networks, 2017
- Understanding GPU PowerACM Computing Surveys, 2016
- Online Power Estimation of Graphics Processing Units2016
- Dissecting GPU Memory Hierarchy Through MicrobenchmarkingIEEE Transactions on Parallel and Distributed Systems, 2016
- The CRISP performance model for dynamic voltage and frequency scaling in a GPGPU2015
- Equalizer: Dynamic Tuning of GPU Resources for Efficient Execution2014
- Power and Performance Characterization and Modeling of GPU-Accelerated Systems2014
- A measurement study of GPU DVFS on energy conservation2013
- Effects of Dynamic Voltage and Frequency Scaling on a K20 GPU2013
- GPUWattch2013