HICA: A Hybrid Scientific Workflow Scheduling Algorithm for Symmetric Homogeneous Resource Cloud Environments
Open Access
Abstract
With the increasing volume of scientific computation data and the advancement of computer performance, scientific computation is becoming more dependent on the powerful computing capabilities of cloud computing. On cloud platforms, tasks in scientific workflows are assigned to computational resources and executed according to specific strategies. Therefore, workflow scheduling has become a key factor affecting efficiency. This paper proposes a hybrid scientific workflow scheduling algorithm, HICA, to address the scheduling problem of scientific workflows in symmetric homogeneous cloud environments with optimization goals of makespan and cost. HICA combines the Imperialist Competitive Algorithm (ICA) with the HEFT algorithm, integrating HEFT into the initial population of the ICA to accelerate the convergence of the ICA. Experimental results show that the proposed hybrid approach outperforms other algorithms in real-world workflow applications. Specifically, when the workflow scale is 100, the average improvements in makespan and cost are 133.89 and 273.33, respectively; when the workflow scale is 1000, the improvements are 371.62 and 9178.98. The scheduling results for the Earth System Model parameter tuning workflow show that compared to the scenario without using a scheduling algorithm, the makespan and cost were improved by 13% and 21%, respectively.Keywords
Funding Information
- National Key R&D Plan of China (2017YFA0604500, 20180201103GX, 2020YFB0204800, T2125006, BM2022028)
- Key scientific and technological R&D Plan of Jilin Province of China (2017YFA0604500, 20180201103GX, 2020YFB0204800, T2125006, BM2022028)
- National Key Research and Development Plan of China (2017YFA0604500, 20180201103GX, 2020YFB0204800, T2125006, BM2022028)
- National Natural Science Foundation of China (2017YFA0604500, 20180201103GX, 2020YFB0204800, T2125006, BM2022028)
- Jiangsu Innovation Capacity Building Program (2017YFA0604500, 20180201103GX, 2020YFB0204800, T2125006, BM2022028)
This publication has 36 references indexed in Scilit:
- CSFPA: An intelligent hybrid workflow scheduling algorithm based upon global and local optimization approach in cloudConcurrency and Computation: Practice and Experience, 2022
- A global optimizer inspired from the survival strategies of flying foxesEngineering with Computers, 2022
- Scientific workflow scheduling in multi-cloud computing using a hybrid multi-objective optimization algorithmJournal of Ambient Intelligence and Humanized Computing, 2021
- An effective meta-heuristic based multi-objective hybrid optimization method for workflow scheduling in cloud computing environmentCluster Computing, 2021
- Workflow scheduling in cloud environment using a novel metaheuristic optimization algorithmInternational Journal of Communication Systems, 2021
- Meta-heuristic Approaches for Effective Scheduling in Infrastructure as a Service Cloud: A Systematic ReviewJournal of Network and Systems Management, 2021
- A hybrid multi-objective metaheuristic optimization algorithm for scientific workflow schedulingCluster Computing, 2020
- A hybrid genetic algorithm for scientific workflow scheduling in cloud environmentNeural Computing and Applications, 2020
- CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithmsSoftware: Practice and Experience, 2010
- Scientific workflow management and the Kepler systemConcurrency and Computation: Practice and Experience, 2005