Transparent Acceleration for Heterogeneous Platforms With Compilation to OpenCL
Open Access
- 18 April 2019
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Architecture and Code Optimization
- Vol. 16 (2) , 1-26
Abstract
Multi-accelerator platforms combine CPUs and different accelerator architectures within a single compute node. Such systems are capable of processing parallel workloads very efficiently while being more energy efficient than regular systems consisting of CPUs only. However, the architectures of such systems are diverse, forcing developers to port applications to each accelerator using different programming languages, models, tools, and compilers. Developers not only require domain-specific knowledge but also need to understand the low-level accelerator details, leading to an increase in the design effort and costs. To tackle this challenge, we propose a compilation approach and a practical realization called HT r OP that is completely transparent to the user. HT r OP is able to automatically analyze a sequential CPU application, detect computational hotspots, and generate parallel OpenCL host and kernel code. The potential of HT r OP is demonstrated by offloading hotspots to different OpenCL-enabled resources (currently the CPU, the general-purpose GPU, and the manycore Intel Xeon Phi) for a broad set of benchmark applications. We present an in-depth evaluation of our approach in terms of performance gains and energy savings, taking into account all static and dynamic overheads. We are able to achieve speedups and energy savings of up to two orders of magnitude, if an application has sufficient computational intensity, when compared to a natively compiled application.Keywords
Funding Information
- German Research Foundation (DFG) within the Collaborative Research Centre “On-The-Fly Computing” (SFB 901)
This publication has 27 references indexed in Scilit:
- Understanding Portability of a High-Level Programming Model on Contemporary Heterogeneous ArchitecturesIEEE Micro, 2015
- Polyhedral parallel code generation for CUDAACM Transactions on Architecture and Code Optimization, 2013
- POLLY — PERFORMING POLYHEDRAL OPTIMIZATIONS ON A LOW-LEVEL INTERMEDIATE REPRESENTATIONParallel Processing Letters, 2012
- Achieving a single compute device image in OpenCL for multiple GPUsACM SIGPLAN Notices, 2011
- A practical automatic polyhedral parallelizer and locality optimizerACM SIGPLAN Notices, 2008
- pn: A Tool for Improved Derivation of Process NetworksEURASIP Journal on Embedded Systems, 2007
- Semi-Automatic Composition of Loop Transformations for Deep Parallelism and Memory HierarchiesInternational Journal of Parallel Programming, 2006
- Energy-aware runtime scheduling for embedded-multiprocessor SOCsIEEE Design & Test of Computers, 2001
- OpenMP: an industry standard API for shared-memory programmingIEEE Computational Science and Engineering, 1998
- A high-performance, portable implementation of the MPI message passing interface standardParallel Computing, 1996