IRIS: A Performance-Portable Framework for Cross-Platform Heterogeneous Computing
- 19 July 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Parallel and Distributed Systems
- Vol. 35 (10) , 1796-1809
Abstract
From edge to exascale, computer architectures are becoming more heterogeneous and complex. The systems typically have fat nodes, with multicore CPUs and multiple hardware accelerators such as GPUs, FPGAs, and DSPs. This complexity is causing a crisis in programming systems and performance portability. Several programming systems are working to address these challenges, but the increasing architectural diversity is forcing software stacks and applications to be specialized for each architecture. As we show, all of these approaches critically depend on their software framework for discovery, execution, scheduling, and data orchestration. To address this challenge, we believe that a more agile and proactive software framework is essential to increase performance portability and improve user productivity. To this end, we have designed and implemented IRIS: a performance-portable framework for cross-platform heterogeneous computing. IRIS can discover available resources, manage multiple diverse programming platforms (e.g., CUDA, Hexagon, HIP, Level Zero, OpenCL, OpenMP) simultaneously in the same execution, respect data dependencies, orchestrate data movement proactively, and provide for user-configurable scheduling. To simplify data movement, IRIS introduces a shared virtual device memory with relaxed consistency among different heterogeneous devices. IRIS also adds an automatic kernel workload partitioning technique using the polyhedral model so that it can resize kernels for a wide range of devices. Our evaluation on three architectures, ranging from Qualcomm Snapdragon to a Summit supercomputer node, shows that IRIS improves portability across a wide range of diverse heterogeneous architectures with negligible overhead.Keywords
Funding Information
- Experimental Computing Laboratory
- Oak Ridge Leadership Computing Facility at Oak Ridge National Laboratory
- US Department of Energy's Office of Science (DE-AC05-00OR22725)
- Defense Advanced Research Projects Agency's Microsystems Technology Office, Domain-Specific System-on-Chip Program and
- U.S. Department of War
- Era of Extremely Heterogeneous and Ephemeral Computer Architectures
- RAPIDS Institute
- U.S. Department of Energy
- Office of Science
- Office of Advanced Scientific Computing Research
- Scientific Discovery through Advanced Computing
This publication has 39 references indexed in Scilit:
- Automatic Horizontal Fusion for GPU Kernels2022
- IRIS: A Portable Runtime System Exploiting Multiple Heterogeneous Programming Systems2021
- Implications of a metric for performance portabilityFuture Generation Computer Systems, 2019
- The Open Community Runtime: A runtime system for extreme scale computing2016
- KLAP: Kernel launch aggregation and promotion for optimizing dynamic parallelism2016
- Achieving Exascale Capabilities through Heterogeneous ComputingIEEE Micro, 2015
- PaRSEC: Exploiting Heterogeneity to Enhance ScalabilityComputing in Science & Engineering, 2013
- Productive Programming of GPU Clusters with OmpSs2012
- Maestro: Data Orchestration and Tuning for OpenCL Devices2010
- StarPU: A Unified Platform for Task Scheduling on Heterogeneous Multicore Architectures2009