Energy-Aware Workload Consolidation on GPU
Authors:
- Dong LiDLDong Li
- Surendra BynaSBSurendra Byna
- Srimat ChakradharSCSrimat Chakradhar
- 1 September 2011
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 389-398
Abstract
Enterprise workloads like search, data mining and analytics, etc. typically involve a large number of users who are simultaneously using applications that are hosted on clusters of commodity computers. Use of GPUs for enterprise computing is challenging because of poor performance and higher energy consumption compared to running enterprise workloads on CPUs. In this paper, we show that the GPU work consolidation can improve system throughput and results in significant energy savings over multicore CPUs. We develop a novel runtime framework that dynamically consolidates instances from different workloads from multiple user processes into a single GPU workload. However, arbitrary consolidation of GPU workloads does not always lead to better energy efficiency. We use new GPU performance and power models to make predictions for potential workload consolidation alternatives and identify useful consolidations. Our experiments on a variety of workloads (that perform poorly on a GPU compared to well optimized multicore CPU implementations) show that the proposed framework for GPUcan provide 2X to 22X energy benefit over a multicore CPU.Keywords
This publication has 15 references indexed in Scilit:
- Energy-Aware Workload Consolidation on GPU2011
- Supporting GPU sharing in cloud environments with a transparent runtime consolidation framework2011
- A first look at integrated GPUs for green high-performance computingComputer Science - Research and Development, 2010
- Statistical power modeling of GPU kernels using performance counters2010
- Rodinia: A benchmark suite for heterogeneous computing2009
- An analytical model for a GPU architecture with memory-level and thread-level parallelism awareness2009
- On the energy efficiency of graphics processing units for scientific computing2009
- Power Efficient Large Matrices Multiplication by Load Scheduling on Multi-core and GPU Platform with CUDA2009
- SPRAT: Runtime processor selection for energy-aware computing2008
- Temperature-aware microarchitectureACM Transactions on Architecture and Code Optimization, 2004