Performance evaluation of Java/PCJ implementation of parallel algorithms on the cloud (extended version)
- 2 August 2021
- journal article
- research article
- Published by Wiley in Concurrency and Computation: Practice and Experience
- Vol. 35 (15) , e6536
Abstract
Large‐scale computing and data processing with cloud resources is gaining popularity. However, the usage of the cloud differs from traditional high‐performance computing (HPC) systems and both algorithms and codes have to be adjusted. This work is often time‐consuming and performance is not guaranteed. To address this problem we have developed the PCJ library (parallel computing in Java), a novel tool for scalable HPC and big data processing in Java. In this article, we present a performance evaluation of parallel applications implemented in Java using the PCJ library. The performance evaluation is based on the examples of highly scalable applications of different characteristics focusing on CPU, communication or I/O. They run on the traditional HPC system and Amazon web services Cloud as well as Linaro Developer Cloud. For the clouds, we have used Intel x86 and ARM processors for running Java codes without changing any line of the program code and without the need for time‐consuming recompilation. Presented applications have been parallelized using the partitioned global address space programming model and its realization in the PCJ library. Our results prove that the PCJ library, due to its performance and ability to create simple portable code, has great promise to be successful for the parallelization of various applications and run them on the cloud with a performance close to HPC systems.Keywords
Funding Information
- Intercollegiate Center for Management Science (GB65‐15, GA69‐19)
This publication has 26 references indexed in Scilit:
- Towards Green Aviation with Python at Petascale2017
- Julia: A Fresh Approach to Numerical ComputingSIAM Review, 2017
- Design and implementation of Java bindings in Open MPIParallel Computing, 2016
- Parallel Differential Evolution in the PGAS Programming Model Implemented with PCJ Java Library2016
- The APGAS library: resilient parallel and distributed programming in Java 82015
- Parallel computations in Java with PCJ library2012
- The new features of Fortran 2008ACM SIGPLAN Fortran Forum, 2008
- Parallel Programmability and the Chapel LanguageThe International Journal of High Performance Computing Applications, 2007
- A more efficient RMI for Java1999
- Global arrays: A nonuniform memory access programming model for high-performance computersThe Journal of Supercomputing, 1996