On the dynamic resource availability in grids
- 1 September 2007
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 21521085,p. 26-33
Abstract
Currently deployed grids gather together thousands of computational and storage resources for the benefit of a large community of scientists. However, the large scale, the wide geographical spread, and at times the decision of the rightful resource owners to commit the capacity elsewhere, raises serious resource availability issues. Little is known about the characteristics of the grid resource availability, and of the impact of resource unavailability on the performance of grids. In this work, we make first steps in addressing this twofold lack of information. First, we analyze a long-term availability trace and assess the resource availability characteristics of Grid'5000, an experimental grid environment of over 2,500 processors. The average utilization for the studied trace is increased by almost 5%, when availability is considered. Based on the results of the analysis, we further propose a model for grid resource availability. Our analysis and modeling results show that grid computational resources become unavailable at a high rate, negatively affecting the ability of grids to execute long jobs. Second, through trace-based simulation, we show evidence that resource availability can have a severe impact on the performance of the grid systems. The results of this step show evidence that the performance of a grid system can rise when availability is taken into consideration, and that human administration of availability change information results in 10-15 times more job failures than for an automated monitoring solution, even for a lowly utilized system.Keywords
This publication has 17 references indexed in Scilit:
- Grid'5000: A Large Scale And Highly Reconfigurable Experimental Grid TestbedThe International Journal of High Performance Computing Applications, 2006
- The ganglia distributed monitoring system: design, implementation, and experienceParallel Computing, 2004
- Password Authenticated Key Exchange Using Quadratic Residues2004
- Understanding Availability2003
- On-line algorithmsACM Computing Surveys, 1999
- Scheduling for Parallel Supercomputing: A Historical Perspective of Achievable Utilization1999
- On-line scheduling1998
- Dependability measurement and modeling of a multicomputer systemIEEE Transactions on Computers, 1993
- A census of Tandem system availability between 1985 and 1990IEEE Transactions on Reliability, 1990
- On the Kolmogorov-Smirnov Test for the Exponential Distribution with Mean UnknownJournal of the American Statistical Association, 1969