GA-Based Task Scheduler for the Cloud Computing Systems
Authors:
- Yujia GeYGYujia Ge
- Guiyi WeiGWGuiyi Wei
- 1 October 2010
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2, 181-186
Abstract
Task scheduling problems are of paramount importance which relate to the efficiency of the whole cloud computing facilities. In Hadoop, the open-source implementation of MapReduce, scheduling policies, such as FIFO or delay scheduling in FAIR scheduler is used by the master node to distribute waiting tasks to computing nodes (slaves) in response to the status messages of these nodes it receives. Although delay scheduling policy has claimed to improve the throughput and response times by a factor of 2 compared to FIFO policy, it can still achieve more improvement by considering a holistic view of all the tasks waiting to be processed. Therefore, this paper proposes a new scheduler which makes a scheduling decision by evaluating the entire group of tasks in the job queue. A genetic algorithm is designed as the optimization method for the new scheduler. The preliminary simulation results show that our scheduler can get a shorter make span for jobs than FIFO and delay scheduling policies and achieve a better balanced load across all the nodes in the cloud.Keywords
This publication has 8 references indexed in Scilit:
- Towards a hybrid load balancing policy in grid computing systemExpert Systems with Applications, 2009
- Search-Based Performance Testing of Applications with Composite Services2009
- Independent Tasks Scheduling Based on Genetic Algorithm in Cloud Computing2009
- A game-theoretic method of fair resource allocation for cloud computing servicesThe Journal of Supercomputing, 2009
- Artificial life techniques for load balancing in computational gridsJournal of Computer and System Sciences, 2007
- Observations on using genetic algorithms for dynamic load-balancingIEEE Transactions on Parallel and Distributed Systems, 2001
- A Comparison of Eleven Static Heuristics for Mapping a Class of Independent Tasks onto Heterogeneous Distributed Computing SystemsJournal of Parallel and Distributed Computing, 2001
- An Introduction to Genetic Algorithms1996