Self-Adaptive Scheduler Parameterization via Online Simulation
Authors:
- 19 April 2005
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 29a
Abstract
Although thoroughly investigated, job scheduling for high-end parallel systems remains an inexact science, requiring significant experience and intuition from system administrators to properly configure batch schedulers. Production schedulers provide many parameters for their configuration, but tuning these parameters appropriately can be very difficult - their effects and interactions are often nonintuitive. In this paper, we introduce a methodology for automating the difficult process of job scheduler parameterization. Our proposed methodology is based on using past workload behavior to predict future workload, and on online simulations of a model of the actual system to provide on-the-fly suggestions to the scheduler for automated parameter adjustment. Detailed performance comparisons via simulation using actual supercomputing traces indicate that out methodology consistently outperforms other workload-aware methods for scheduler parameterization.Keywords
This publication has 5 references indexed in Scilit:
- Self-adapting backfilling scheduling for parallel systems2003
- An integrated approach to parallel scheduling using gang-scheduling, backfilling, and migrationIEEE Transactions on Parallel and Distributed Systems, 2003
- Multiple-Queue Backfilling Scheduling with Priorities and Reservations for Parallel Systems2002
- Core Algorithms of the Maui Scheduler2001
- Utilization, predictability, workloads, and user runtime estimates in scheduling the IBM SP2 with backfillingIEEE Transactions on Parallel and Distributed Systems, 2001