Enabling Transparent Acceleration of Big Data Frameworks Using Heterogeneous Hardware
Open Access
- 1 September 2022
- journal article
- conference paper
- Published by Association for Computing Machinery (ACM) in Proceedings of the VLDB Endowment
- Vol. 15 (13) , 3869-3882
Abstract
The ever-increasing demand for high performance Big Data analytics and data processing, has paved the way for heterogeneous hardware accelerators, such as Graphics Processing Units (GPUs) and Field Programmable Gate Arrays (FPGAs), to be integrated into modern Big Data platforms. Currently, this integration comes at the cost of programmability since the end-user Application Programming Interface (APIs) must be altered to access the underlying heterogeneous hardware. For example, current Big Data frameworks, such as Apache Spark, provide a new API that combines the existing Spark programming model with GPUs. For other Big Data frameworks, such as Flink, the integration of GPUs and FPGAs is achieved via external API calls that bypass their execution models completely. In this paper, we rethink current Big Data frameworks from a systems and programming language perspective, and introduce a novel co-designed approach for integrating hardware acceleration into their execution models. The novelty of our approach is attributed to two key design decisions: a) support for arbitrary User Defined Functions (UDFs), and b) no modifications to the user level API. The proposed approach has been prototyped in the context of Apache Flink, and enables unmodified applications written in Java to run on heterogeneous hardware, such as GPU and FPGAs, transparently to the users. The performance evaluation of the proposed solution has shown performance speedups of up to 65x on GPUs and 184x on FPGAs for suitable workloads of standard benchmarks and industrial use cases against vanilla Flink running on traditional multi-core CPUs.Keywords
This publication has 22 references indexed in Scilit:
- Real-Time Big Data Stream Processing Using GPU with Spark Over Hadoop EcosystemInternational Journal of Parallel Programming, 2017
- GPU-Accelerated Parallel Hierarchical Extreme Learning Machine on Flink for Big DataIEEE Transactions on Systems, Man, and Cybernetics: Systems, 2017
- Portable and transparent software managed scheduling on accelerators for fair resource sharing2016
- Energy-efficient acceleration of big data analytics applications using FPGAs2015
- HeteroDoop2015
- HadoopCL2: Motivating the Design of a Distributed, Heterogeneous Programming System With Machine-Learning ApplicationsIEEE Transactions on Parallel and Distributed Systems, 2015
- SIMD re-convergence at thread frontiers2011
- OpenCL: A Parallel Programming Standard for Heterogeneous Computing SystemsComputing in Science & Engineering, 2010
- GPU ComputingProceedings of the IEEE, 2008
- Reconfigurable computingACM Computing Surveys, 2002