CoGA: Extension of GA on Heterogeneous System
Authors:
- Peng ChengPCPeng Cheng
- Yutong LuYLYutong Lu
- Tao GaoTGTao Gao
- Chenxu WangCWChenxu Wang
- 1 August 2015
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 719-725
Abstract
Heterogeneous computing has been used widely since accelerators like Graphic Processing Unit (GPU) and Intel Many Integrated Core (MIC) can offer an order of magnitude higher compute power for arithmetic intensive data-parallel workloads. However, heterogeneous programming is more complicated since there is no shared memory between CPU and MIC. Programmers must distinguish the local or remote access of data and transmit the data between CPU and MIC explicitly. Furthermore, standard offload programming models like Intel Language Extensions for Offload (LEO) is restricted to a single compute node and hence a limited number of coprocessors also complicate the efficient use of MIC for heterogeneous computations. In this paper, we propose CoGA, the extension of Global Array (GA) for heterogeneous systems consist of CPU and MIC. Our implementation of CoGA is on top of Symmetric Communication Interface (SCIF), a sockets-like API for communication between processes on MIC and host within the same system. CoGA can provide a shared memory abstraction between CPU and MIC and simplifies the programming by allowing programmers to access the shared data regardless where the referenced data is located. Our evaluation on data transmission bandwidth and Sparse-Matrix Vector multiplication problem proves that CoGA is practical and effective.Keywords
This publication has 10 references indexed in Scilit:
- MilkyWay-2 supercomputer: system and applicationFrontiers of Computer Science, 2014
- UPC++: A PGAS Extension for C++2014
- Using the Intel Many Integrated Core to accelerate graph traversalThe International Journal of High Performance Computing Applications, 2014
- Global Futures: A Multithreaded Execution Model for Global Arrays-based Applications2012
- Supporting the Global Arrays PGAS Model Using MPI One-Sided Communication2012
- Tianhe-1A Interconnect and Message-Passing ServicesIEEE Micro, 2011
- Evaluation of Remote Memory Access Communication on the IBM Blue Gene/P Supercomputer2008
- Advances, Applications and Performance of the Global Arrays Shared Memory Programming ToolkitThe International Journal of High Performance Computing Applications, 2006
- A C++ implementation of the co-array programming model for blue gene/L2002
- CHARM++1993