Parallel computing with R: A brief review
- 15 June 2020
- journal article
- review article
- Published by Wiley in WIREs Computational Statistics
- Vol. 13 (2)
Abstract
Parallel computing has established itself as another standard method for applied research and data analysis. The R system, being internally constrained to mostly singly‐threaded operations, can nevertheless be used along with different parallel computing approaches. This brief review covers OpenMP and Intel TBB at the CPU‐ and compiler level, moves to process‐parallel approaches before discussing message‐passing parallelism and big data technologies for parallel processing such as Spark, Docker and Kubernetes before concluding with a focus on the future package integrating many of these approaches.This article is categorized under: Algorithms and Computational Methods > Methods for High Performance Computing Software for Computational Statistics > Software/Statistical Software Software for Computational Statistics > High Performance SoftwareKeywords
All Related Versions
This publication has 12 references indexed in Scilit:
- Extending R with C++: A Brief Introduction to RcppThe American Statistician, 2018
- Singularity: Scientific containers for mobility of computePLOS ONE, 2017
- Apache SparkCommunications of the ACM, 2016
- Overhead Analysis of Performance Counter Measurements2014
- Evaluating the Design of the R Language2012
- LIKWID: A Lightweight Performance-Oriented Tool Suite for x86 Multicore Environments2010
- The Hadoop Distributed File System2010
- State of the Art in Parallel Computing withRJournal of Statistical Software, 2009
- OpenMP: an industry standard API for shared-memory programmingIEEE Computational Science and Engineering, 1998
- Aspects of Applicative Programming for Parallel ProcessingIEEE Transactions on Computers, 1978