Soroush Karimian-Aliabadi
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Soroush Karimian-Aliabadi has a total of 13 co-authors. Here are the top co-authors by number of shared publications:
- Danilo Ardagna
Politecnico di Milano, Milan, Italy
4 shared publications - Bernhard Egger
Seoul National University, Seoul, Republic of Korea
3 shared publications - Reza Entezari-Maleki
School of Computer Engineering, Iran University of Science and Technology, Tehran, Iran
3 shared publications Ali Movaghar
Sharif University of Technology
2 shared publications- Ali Movaghar
Sharif University of Technology
2 shared publications Eugenio Gianniti
2 shared publications
Latest Publications
- 10 March 2024
- Published by Elsevier in Expert Systems with Applications
- Vol. 249
Deadline-aware task offloading in vehicular networks using deep reinforcement learning
- 10 March 2024
- Published by Elsevier in Expert Systems with Applications
- Vol. 249
Deadline-aware task offloading in vehicular networks using deep reinforcement learning
- 19 September 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Services Computing
- Vol. PP (3) , 1-12
Cost-aware Resource Recommendation for DAG-based Big Data Workflows: An Apache Spark Case Study
The era of personal resources being sufficient for enterprise big data computations has passed. As computations are executed in the cloud, small policy changes of cloud operators may cause considerable changes in operational costs. Carefully choosing the amount of resources for a given application is thus of great importance. This, however, requires a priori knowledge of the application's performance under different configurations. Creating a performance prediction model needs to account for the heterogeneity of resources and the diversity in application workflows. Previous approaches for heterogeneous environments consider a black-box representation of the application which results in single-purpose models. This paper addresses the problem with two gray-box prediction models using linear programming (LP) and mixed-integer linear programming (MILP). Given a set of available resources, the models consider Apache Spark applications and their Directed Acyclic Graph (DAG) of workflow running on top of a Hadoop-YARN cluster. We then propose a configuration recommendation algorithm to optimize the cost-performance trade-offs when renting machine instances. The accuracy of the proposed models is evaluated with real-world executions of several representative applications on the Wikipedia dataset and the TPC-DS benchmark. The average error of only 3.28% for the proposed prediction models demonstrates the practicality of the proposed approach in handling cost-performance trade-offs.
- 19 September 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Services Computing
- Vol. PP (3) , 1-12
Cost-aware Resource Recommendation for DAG-based Big Data Workflows: An Apache Spark Case Study
The era of personal resources being sufficient for enterprise big data computations has passed. As computations are executed in the cloud, small policy changes of cloud operators may cause considerable changes in operational costs. Carefully choosing the amount of resources for a given application is thus of great importance. This, however, requires a priori knowledge of the application's performance under different configurations. Creating a performance prediction model needs to account for the heterogeneity of resources and the diversity in application workflows. Previous approaches for heterogeneous environments consider a black-box representation of the application which results in single-purpose models. This paper addresses the problem with two gray-box prediction models using linear programming (LP) and mixed-integer linear programming (MILP). Given a set of available resources, the models consider Apache Spark applications and their Directed Acyclic Graph (DAG) of workflow running on top of a Hadoop-YARN cluster. We then propose a configuration recommendation algorithm to optimize the cost-performance trade-offs when renting machine instances. The accuracy of the proposed models is evaluated with real-world executions of several representative applications on the Wikipedia dataset and the TPC-DS benchmark. The average error of only 3.28% for the proposed prediction models demonstrates the practicality of the proposed approach in handling cost-performance trade-offs.
- 14 October 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cloud Computing
- Vol. 11 (1) , 897-910
Fixed-Point Iteration Approach to Spark Scalable Performance Modeling and Evaluation
Companies depend on mining data to grow their business more than ever. To achieve optimal performance of Big Data analytics workloads, a careful configuration of the cluster and the employed software framework is required. The lack of flexible and accurate performance models, however, render this a challenging task. This paper fills this gap by presenting accurate performance prediction models based on Stochastic Activity Networks (SANs). In contrast to existing work, the presented models consider multiple work queues, a critical feature to achieve high accuracy in realistic usage scenarios. We first introduce a monolithic analytical model for a multi-queue YARN cluster running DAG-based Big Data applications that models each queue individually. To overcome the limited scalability of the monolithic model, we then present a fixed-point model that iteratively computes the throughput of a single queue with respect to the rest of the system until a fixed-point is reached. The models are evaluated on a real-world cluster running the widely-used Apache Spark framework and the YARN scheduler. Experiments with the common transaction-based TPC-DS benchmark show that the proposed models achieve an average error of only 5.6% in predicting the execution time of the Spark jobs.
- 14 October 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cloud Computing
- Vol. 11 (1) , 897-910
Fixed-Point Iteration Approach to Spark Scalable Performance Modeling and Evaluation
Companies depend on mining data to grow their business more than ever. To achieve optimal performance of Big Data analytics workloads, a careful configuration of the cluster and the employed software framework is required. The lack of flexible and accurate performance models, however, render this a challenging task. This paper fills this gap by presenting accurate performance prediction models based on Stochastic Activity Networks (SANs). In contrast to existing work, the presented models consider multiple work queues, a critical feature to achieve high accuracy in realistic usage scenarios. We first introduce a monolithic analytical model for a multi-queue YARN cluster running DAG-based Big Data applications that models each queue individually. To overcome the limited scalability of the monolithic model, we then present a fixed-point model that iteratively computes the throughput of a single queue with respect to the rest of the system until a fixed-point is reached. The models are evaluated on a real-world cluster running the widely-used Apache Spark framework and the YARN scheduler. Experiments with the common transaction-based TPC-DS benchmark show that the proposed models achieve an average error of only 5.6% in predicting the execution time of the Spark jobs.
- 20 October 2019
- Published by Springer Nature in Communications in Computer and Information Science
- p. 441-458
Scalable Performance Modeling and Evaluation of MapReduce Applications
- 20 October 2019
- Published by Springer Nature in Communications in Computer and Information Science
- p. 441-458
Scalable Performance Modeling and Evaluation of MapReduce Applications
- 1 September 2019
- Published by Elsevier in Journal of Network and Computer Applications
- Vol. 142, 63-75
Analytical composite performance models for Big Data applications
- 1 September 2019
- Published by Elsevier in Journal of Network and Computer Applications
- Vol. 142, 63-75
Analytical composite performance models for Big Data applications
- 25 November 2016
- Published by Springer Nature
- p. 599-613
Modeling Performance of Hadoop Applications: A Journey from Queueing Networks to Stochastic Well Formed Nets
- 25 November 2016
- Published by Springer Nature
- p. 599-613
Modeling Performance of Hadoop Applications: A Journey from Queueing Networks to Stochastic Well Formed Nets