Benchmarking Usability and Performance of Multicore Languages
Authors:
- Sebastian NanzSNSebastian Nanz
- Scott WestSWScott West
- Kaue Soares da SilveiraKSKaue Soares da Silveira
- Bertrand MeyerBMBertrand Meyer
- 1 October 2013
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 19493770,p. 183-192
Abstract
Developers face a wide choice of programming languages and libraries supporting multicore computing. Ever more diverse paradigms for expressing parallelism and synchronization become available while their influence on usability and performance remains largely unclear. This paper describes an experiment comparing four markedly different approaches to parallel programming: Chapel, Cilk, Go, and Threading Building Blocks (TBB). Each language is used to implement sequential and parallel versions of six benchmark programs. The implementations are then reviewed by notable experts in the language, thereby obtaining reference versions for each language and benchmark. The resulting pool of 96 implementations is used to compare the languages with respect to source code size, coding time, execution time, and speedup. The experiment uncovers strengths and weaknesses in all approaches, facilitating an informed selection of a language under a particular set of requirements. The expert review step furthermore highlights the importance of expert knowledge when using modern parallel programming approaches.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- Examining the Expert Gap in Parallel ProgrammingLecture Notes in Computer Science, 2013
- How do developers use parallel libraries?2012
- Combining functional and imperative programming for multicore software: An empirical study evaluating Scala and Java2012
- Design of an Empirical Study for Comparing the Usability of Concurrent Programming Languages2011
- Is transactional programming actually easier?2010
- A view of the parallel computing landscapeCommunications of the ACM, 2009
- Parallel Programmer Productivity: A Case Study of Novice Parallel Programmers2005
- Models and languages for parallel computationACM Computing Surveys, 1998
- An experiment to measure the usability of parallel programming systemsConcurrency: Practice and Experience, 1996
- A comparative study of five parallel programming languagesFuture Generation Computer Systems, 1992