Performance and programmability of GrPPI for parallel stream processing on multi-cores
Open Access
- 26 February 2024
- journal article
- research article
- Published by Springer Nature in The Journal of Supercomputing
- Vol. 80 (9) , 12966-13000
Abstract
GrPPI library aims to simplify the burdening task of parallel programming. It provides a unified, abstract, and generic layer while promising minimal overhead on performance. Although it supports stream parallelism, GrPPI lacks an evaluation regarding representative performance metrics for this domain, such as throughput and latency. This work evaluates GrPPI focused on parallel stream processing. We compare the throughput and latency performance, memory usage, and programmability of GrPPI against handwritten parallel code. For this, we use the benchmarking framework SPBench to build custom GrPPI benchmarks and benchmarks with handwritten parallel code using the same backends supported by GrPPI. The basis of the benchmarks is real applications, such as Lane Detection, Bzip2, Face Recognizer, and Ferret. Experiments show that while performance is often competitive with handwritten parallel code, the infeasibility of fine-tuning GrPPI is a crucial drawback for emerging applications. Despite this, programmability experiments estimate that GrPPI can potentially reduce the development time of parallel applications by about three times.Keywords
All Related Versions
Funding Information
- Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (001)
- Fundação de Amparo à Pesquisa do Estado do Rio Grande do Sul (21/2551-0000725-7)
- European Union's Horizon 2020 JTI-EuroHPC (956748, 956748)
- Ministerio de Ciencia e Innovación (956748, 956748)
- Università degli Studi di Torino
This publication has 23 references indexed in Scilit:
- Exploiting Stream Parallelism of MRI Reconstruction Using GrPPI over Multiple Back-Ends2019
- Exploring stream parallel patterns in distributed MPI environmentsParallel Computing, 2019
- Challenging the abstraction penalty in parallel patterns librariesThe Journal of Supercomputing, 2019
- Paving the way towards high-level parallel pattern interfaces for data stream processingFuture Generation Computer Systems, 2018
- Supporting MPI-distributed stream parallel patterns in GrPPI2018
- A generic parallel pattern interface for stream and data processingConcurrency and Computation: Practice and Experience, 2017
- SPar: A DSL for High-Level and Productive Stream ParallelismParallel Processing Letters, 2017
- Fastflow: High‐Level and Efficient Streaming on Multicore2017
- The PARSEC benchmark suite2008
- A Modern Introduction to Probability and Statistics2005