Asynchronous Execution of Python Code on Task-Based Runtime Systems
Authors:
- R. TohidRTR. Tohid
- Bibek WagleBWBibek Wagle
- Shahrzad ShirzadSSShahrzad Shirzad
- Patrick DiehlPDPatrick Diehl
- Adrian SerioASAdrian Serio
- Alireza KheirkhahanAKAlireza Kheirkhahan
- Parsa AminiPAParsa Amini
- Katy WilliamsKWKaty Williams
- Kate IsaacsKIKate Isaacs
- Kevin HuckKHKevin Huck
- Steven BrandtSBSteven Brandt
- Hartmut KaiserHKHartmut Kaiser
- 1 November 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 37-45
Abstract
Despite advancements in the areas of parallel and distributed computing, the complexity of programming on High Performance Computing (HPC) resources has deterred many domain experts, especially in the areas of machine learning and artificial intelligence (AI), from utilizing performance benefits of such systems. Researchers and scientists favor high-productivity languages to avoid the inconvenience of programming in low-level languages and costs of acquiring the necessary skills required for programming at this level. In recent years, Python, with the support of linear algebra libraries like NumPy, has gained popularity despite facing limitations which prevent this code from distributed runs. Here we present a solution which maintains both high level programming abstractions as well as parallel and distributed efficiency. Phylanx, is an asynchronous array processing toolkit which transforms Python and NumPy operations into code which can be executed in parallel on HPC resources by mapping Python and NumPy functions and variables into a dependency tree executed by HPX, a general purpose, parallel, task-based runtime system written in C++. Phylanx additionally provides introspection and visualization capabilities for debugging and performance analysis. We have tested the foundations of our approach by comparing our implementation of widely used machine learning algorithms to accepted NumPy standards.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- A formal definition of Big Data based on its essential featuresLibrary Review, 2016
- Higher-level parallelization for local and distributed asynchronous task-based programming2015
- A survey of open source tools for machine learning with big data in the Hadoop ecosystemJournal of Big Data, 2015
- Efficient Machine Learning for Big Data: A ReviewBig Data Research, 2015
- Deep learningNature, 2015
- The rise of “big data” on cloud computing: Review and open research issuesInformation Systems, 2015
- HPX2014
- Expression Templates Revisited: A Performance Analysis of Current MethodologiesSIAM Journal on Scientific Computing, 2012
- The NumPy Array: A Structure for Efficient Numerical ComputationComputing in Science & Engineering, 2011
- Active Messages: A Mechanism for Integrated Communication and Computation2005