Petascale computing with accelerators
Authors:
Open Access
- 14 February 2009
- journal article
- Published by Association for Computing Machinery (ACM) in ACM SIGPLAN Notices
- Vol. 44 (4) , 241-250
Abstract
A trend is developing in high performance computing in which commodity processors are coupled to various types of computational accelerators. Such systems are commonly called hybrid systems. In this paper, we describe our experience developing an implementation of the Linpack benchmark for a petascale hybrid system, the LANL Roadrunner cluster built by IBM for Los Alamos National Laboratory. This system combines traditional x86-64 host processors with IBM PowerXCell™" 8i1 accelerator processors. The implementation of Linpack we developed was the first to achieve a performance result in excess of 1.0 PFLOPS, and made Roadrunner the #1 system on the Top500 list in June 2008. We describe the design and implementation of hybrid Linpack, including the special optimizations we developed for this hybrid architecture. We then present actual results for single node and multi-node executions. From this work, we conclude that it is possible to achieve high performance for certain applications on hybrid architectures when careful attention is given to efficient use of memory bandwidth, scheduling of data movement between the host and accelerator memories, and proper distribution of work between the host and accelerator processors.Keywords
This publication has 9 references indexed in Scilit:
- Anatomy of high-performance matrix multiplicationACM Transactions on Mathematical Software, 2008
- Multi-threading and one-sided communication in parallel LU factorization2007
- Introduction to the Cell Broadband Engine ArchitectureIBM Journal of Research and Development, 2007
- Using advanced compiler technology to exploit the performance of the Cell Broadband Engine™ architectureIBM Systems Journal, 2006
- Performance evaluation of Allgather algorithms on terascale Linux cluster with fast Ethernet2005
- High-performance linear algebra algorithms using new generalized data structures for matricesIBM Journal of Research and Development, 2003
- Scalability Issues Affecting the Design of a Dense Linear Algebra LibraryJournal of Parallel and Distributed Computing, 1994
- A set of level 3 basic linear algebra subprogramsACM Transactions on Mathematical Software, 1990
- Basic Linear Algebra Subprograms for Fortran UsageACM Transactions on Mathematical Software, 1979