GFlink: An In-Memory Computing Architecture on Heterogeneous CPU-GPU Clusters for Big Data
- 16 January 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Parallel and Distributed Systems
- Vol. 29 (6) , 1275-1288
Abstract
The increasing main memory capacity and the explosion of big data have fueled the development of in-memory big data management and processing. By offering an efficient in-memory parallel execution model which can eliminate disk I/O bottleneck, existing in-memory cluster computing platforms (e.g., Flink and Spark) have already been proven to be outstanding platforms for big data processing. However, these platforms are merely CPU-based systems. This paper proposes GFlink, an in-memory computing architecture on heterogeneous CPU-GPU clusters for big data. Our proposed architecture extends the original Flink from CPU clusters to heterogeneous CPU-GPU clusters, greatly improving the computational power of Flink. Furthermore, we have proposed a programming framework based on Flink's abstract model, i.e., DataSet (DST), hiding the programming complexity of GPUs behind the simple and familiar high-level interfaces. To achieve high performance and good load-balance, an efficient JVM-GPU communication strategy, a GPU cache scheme, and an adaptive locality-aware scheduling scheme for three-stage pipelining execution are proposed. Extensive experiment results indicate that the high computational power of GPUs can be efficiently utilized, and the implementation on GFlink outperforms that on the original CPU-based Flink.Keywords
Funding Information
- Key Program of National Natural Science Foundation of China (61432005)
- National Outstanding Youth Science Program of National Natural Science Foundation of China (61625202)
- International (Regional) Cooperation and Exchange Program of National Natural Science Foundation of China (61661146006)
- the Singapore-China NRF-NSFC (NRF2016NRF-NSFC001-111)
- National Natural Science Foundation of China (61370095, 61472124, 61662090, 61602350)
- Key Technology Research and Development Programs of Guangdong Province (2015B010108006)
- National Key R&D Program of China (2016YFB0201303)
This publication has 23 references indexed in Scilit:
- Spark-GPU: An accelerated in-memory data processing engine on clusters2016
- GFlink: An In-Memory Computing Architecture on Heterogeneous CPU-GPU Clusters for Big Data2016
- Spark Versus Flink: Understanding Performance in Big Data Analytics Frameworks2016
- SWAT2016
- G-Storm: GPU-enabled high-throughput online data processing in Storm2015
- Automatic data placement into GPU on-chip memory resources2015
- Characterizing and enhancing global memory data coalescing on GPUs2015
- Performance Models for CPU-GPU Data Transfers2014
- Where is the data? Why you cannot debate CPU vs. GPU performance without the answer2011
- Mars2008