FinePar: Irregularity-aware fine-grained workload partitioning on integrated architectures
Authors:
- 1 February 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 27-38
Abstract
The integrated architecture that features both CPU and GPU on the same die is an emerging and promising architecture for fine-grained CPU-GPU collaboration. However, the integration also brings forward several programming and system optimization challenges, especially for irregular applications. The complex interplay between heterogeneity and irregularity leads to very low processor utilization of running irregular applications on integrated architectures. Furthermore, fine-grained co-processing on the CPU and GPU is still an open problem. Particularly, in this paper, we show that the previous workload partitioning for CPU-GPU co-processing is far from ideal in terms of resource utilization and performance. To solve this problem, we propose a system software named FinePar, which considers architectural differences of the CPU and GPU and leverages finegrained collaboration enabled by integrated architectures. Through irregularity-aware performance modeling and online auto-tuning, FinePar partitions irregular workloads and achieves both device-level and thread-level load balance. We evaluate FinePar with 8 irregular applications on an AMD integrated architecture and compare it with state-of-the-art partitioning approaches. Results show that FinePar demonstrates better resource utilization and achieves an average of 1.38X speedup over the optimal coarse-grained partitioning method.Keywords
This publication has 28 references indexed in Scilit:
- CSR52015
- Automatic Selection of Sparse Matrix Representation on GPUs2015
- Integrating profile-driven parallelism detection and machine-learning-based mappingACM Transactions on Architecture and Code Optimization, 2014
- Revisiting co-processing for hash joins on the coupled CPU-GPU architectureProceedings of the VLDB Endowment, 2013
- A yoke of oxen and a thousand chickens for heavy lifting graph processing2012
- clSpMV2012
- Random walk with restart: fast solutions and applicationsKnowledge and Information Systems, 2007
- R-MAT: A Recursive Model for Graph Mining2004
- Multiple Linear Regression2003
- Authoritative sources in a hyperlinked environmentJournal of the ACM, 1999