Utility Functions and Resource Management in an Oversubscribed Heterogeneous Computing Environment
Authors:
- 26 September 2014
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computers
- Vol. 64 (8) , 2394-2407
Abstract
We model an oversubscribed heterogeneous computing system where tasks arrive dynamically and a scheduler maps the tasks to machines for execution. The environment and workloads are based on those being investigated by the Extreme Scale Systems Center at Oak Ridge National Laboratory. Utility functions that are designed based on specifications from the system owner and users are used to create a metric for the performance of resource allocation heuristics. Each task has a time-varying utility (importance) that the enterprise will earn based on when the task successfully completes execution. We design multiple heuristics, which include a technique to drop low utility-earning tasks, to maximize the total utility that can be earned by completing tasks. The heuristics are evaluated using simulation experiments with two levels of oversubscription. The results show the benefit of having fast heuristics that account for the importance of a task and the heterogeneity of the environment when making allocation decisions in an oversubscribed environment. The ability to drop low utility-earning tasks allow the heuristics to tolerate the high oversubscription as well as earn significant utility.Keywords
Funding Information
- National Center for Computational Sciences at Oak Ridge National Laboratory
- Extreme Scale Systems Center at ORNL
- Department of Defense
- National Science Foundation Graduate Research Fellowship
- NSF (CCF-1302693)
- NSF (CNS-0923386)
This publication has 26 references indexed in Scilit:
- Heuristics for Robust Resource Allocation of Satellite Weather Data Processing on a Heterogeneous Parallel SystemIEEE Transactions on Parallel and Distributed Systems, 2011
- A Framework for Measuring Supercomputer ProductivityThe International Journal of High Performance Computing Applications, 2004
- A formally verified application-level framework for real-time scheduling on POSIX real-time operating systemsIEEE Transactions on Software Engineering, 2004
- An Integrated Technique for Task Matching and Scheduling onto Distributed Heterogeneous Computing SystemsJournal of Parallel and Distributed Computing, 2002
- A Comparison of Eleven Static Heuristics for Mapping a Class of Independent Tasks onto Heterogeneous Distributed Computing SystemsJournal of Parallel and Distributed Computing, 2001
- QoS and Contention-Aware Multi-Resource ReservationCluster Computing, 2001
- Optimal task assignment in heterogeneous distributed computing systemsIEEE Concurrency, 1998
- A distributed heterogeneous supercomputing management systemComputer, 1993
- Heterogeneous computing: challenges and opportunitiesComputer, 1993
- Semi-distributed load balancing for massively parallel multicomputer systemsIEEE Transactions on Software Engineering, 1991