Abstract
Stencil computations are a representative class of applications in HPC. In this work, we extend EPSILOD, a parallel skeleton for Iterative Stencil Loops in distributed heterogeneous systems to support Intel FPGAs. We call the extended version EPSILOD-Het. EPSILOD-Het can compute Iterative Stencil Loops concurrently on CPUs, GPUs and FPGAs, allowing the resources of highly heterogeneous systems to be combined within the same execution. We discuss the integration of FPGAs into portability layers and parallel skeletons, highlighting challenges, possible solutions, and limitations. We conduct experimental studies to assess EPSILOD-Het's performance in different aspects. Our results suggest that: (a) EPSILOD-Het achieves comparable FPGA performance for basic 2D and 3D stencils to implementations using both FPGA reference versions and programs generated with another portability layer; (b) that the FPGA implementation in EPSILOD-Het offers competitive throughput and the highest energy efficiency among the devices tested, especially for compute-intensive stencils.; and (c) that EPSILOD-Het efficiently combines GPU and FPGA resources in the tested scenarios using a static load-balancing strategy, while some CPU-inclusive executions reveal limitations. For example, by concurrently using a GPU and an FPGA, EPSILOD-Het can compute up to 115\% more domain elements than the GPU alone in the same time, or the same domain elements in up to 52.15\% less time.