A Performance and Energy Consumption Analytical Model for GPU
Authors:
- Cheng LuoCLCheng Luo
- Reiji SudaRSReiji Suda
- 1 December 2011
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 658-665
Abstract
Even with a powerful hardware in parallel execution, it is still difficult to improve the application performance and reduce energy consumption without realizing the performance bottlenecks of parallel programs on GPU architectures. To help programmers have a better insight into the performance and energy-saving bottleneck of parallel applications on GPU architectures, we propose two models: an execution time prediction model and an energy consumption prediction model. The execution time prediction model(ETPM) can estimate the execution time of massively parallel programs which take the instruction-level and thread-level parallelism into consideration. ETPM contains two components: memory sub-model and computation sub-model. The memory sub-model is estimating the cost of memory instructions by considering the number of active threads and GPU memory bandwidth. Correspondingly, the computation sub-model is estimating the cost of computation instructions by considering the number of active threads and the application's arithmetic intensity. We use ocelot to analysis PTX codes to obtain several input parameters for the two sub-models such as the memory transaction number and data size. Basing on the two sub-models, the analytical model can estimates the cost of each instruction while considering instruction-level and thread-level parallelism, thereby estimating the overall execution time of an application. The energy consumption prediction model(ECPM) can estimate the total energy consumption basing on the data from ETPM. We compare the outcome from the models and the actual execution on GTX260 and Tesla C2050. The results show that the models can reach almost 90 percentage accuracy in average for the benchmarks we used.Keywords
This publication has 7 references indexed in Scilit:
- An analytical model for a GPU architecture with memory-level and thread-level parallelism awareness2009
- Performance modeling and automatic ghost zone optimization for iterative stencil loops on GPUs2009
- Exploring the multiple-GPU design space2009
- Program optimization space pruning for a multithreaded gpu2008
- Merge2008
- The Queue-Read Queue-Write PRAM Model: Accounting for Contention in Parallel AlgorithmsSIAM Journal on Computing, 1998
- LogP: towards a realistic model of parallel computation1993