Understanding Co-Running Behaviors on Integrated CPU/GPU Architectures
- 29 June 2016
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Parallel and Distributed Systems
- Vol. 28 (3) , 905-918
Abstract
Architecture designers tend to integrate both CPUs and GPUs on the same chip to deliver energy-efficient designs. It is still an open problem to effectively leverage the advantages of both CPUs and GPUs on integrated architectures. In this work, we port 42 programs in Rodinia, Parboil, and Polybench benchmark suites and analyze the co-running behaviors of these programs on both AMD and Intel integrated architectures. We find that co-running performance is not always better than running the program only with CPUs or GPUs. Among these programs, only eight programs can benefit from the co-running, while 24 programs only using GPUs and seven programs only using CPUs achieve the best performance. The remaining three programs show little performance preference for different devices. Through extensive workload characterization analysis, we find that architecture differences between CPUs and GPUs and limited shared memory bandwidth are two main factors affecting current co-running performance. Since not all the programs can benefit from integrated architectures, we build an automatic decision-tree-based model to help application developers predict the co-running performance for a given CPU-only or GPU-only program. Results show that our model correctly predicts 14 programs out of 15 for evaluated programs. For a co-run friendly program, we further propose a profiling-based method to predict the optimal workload partition ratio between CPUs and GPUs. Results show that our model can achieve 87.7 percent of the optimal performance relative to the best partition. The co-running programs acquired with our method outperform the original CPU-only and GPU-only programs by 34.5 and 20.9 percent respectively.Keywords
Funding Information
- Chinese 863 project (2012AA010901)
- NSFC (61472201)
- Tsinghua University
- Initiative Scientific Research Program
- Tsinghua-Tencent Joint Laboratory for Internet Innovation Technology
- Huawei Innovation Research Program (HIRP) in China
- MOE
- AcRF (MOE2012-T2-2-067)
This publication has 23 references indexed in Scilit:
- Understanding Co-run Degradations on Integrated Heterogeneous Processors2015
- In-cache query co-processing on coupled CPU-GPU architecturesProceedings of the VLDB Endowment, 2014
- Adaptive heterogeneous scheduling for integrated GPUs2014
- Efficient Mapping of Irregular C++ Applications to Integrated GPUs2014
- Heterogeneous system coherence for integrated CPU-GPU systems2013
- OmniDBProceedings of the VLDB Endowment, 2013
- Revisiting co-processing for hash joins on the coupled CPU-GPU architectureProceedings of the VLDB Endowment, 2013
- Performance characterization of data-intensive kernels on AMD Fusion architecturesComputer Science - Research and Development, 2012
- The tradeoffs of fused memory hierarchies in heterogeneous computing architectures2012
- RooflineCommunications of the ACM, 2009