Parallel Computing With R: A Brief Review
Author:
Preprint
Abstract
Parallel computing has established itself as another standard method for applied research and data analysis. The R system, being internally constrained to mostly singly-threaded operations, can nevertheless be used along with different parallel computing approaches. This brief review covers OpenMP and Intel TBB at the cpu- and compiler level, moves to process-parallel approaches before discussing message-passing parallelism and big data technologies for parallel processing such as Spark, Docker and Kubernetes before concluding with a focus on the future package integrating many of these approaches.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- Extending R with C++: A Brief Introduction to RcppThe American Statistician, 2018
- Singularity: Scientific containers for mobility of computePLOS ONE, 2017
- Overhead Analysis of Performance Counter Measurements2014
- dplyr: A Grammar of Data Manipulation2014
- The Hadoop Distributed File System2010
- RcppArmadillo: 'Rcpp' Integration for the 'Armadillo' Templated Linear Algebra Library2010
- doMPI: Foreach Parallel Adaptor for the Rmpi Package2009
- State of the Art in Parallel Computing withRJournal of Statistical Software, 2009
- Rcpp: Seamless R and C++ Integration2008
- OpenMP: an industry standard API for shared-memory programmingIEEE Computational Science and Engineering, 1998