Scheduling with implicit information in distributed systems
Authors:
Open Access
- 1 June 1998
- conference paper
- Published by Association for Computing Machinery (ACM)
- Vol. 26 (1) , 233-243
Abstract
Implicit coscheduling is a distributed algorithm for time-sharing communicating processes in a cluster of workstations. By observing and reacting to implicit information, local schedulers in the system make independent decisions that dynamically coordinate the scheduling of communicating processes. The principal mechanism involved is two-phase spin-blocking: a process waiting for a message response spins for some amount of time, and then relinquishes the processor if the response does not arrive.In this paper, we describe our experience implementing implicit coscheduling on a cluster of 16 UltraSPARC I workstations; this has led to contributions in three main areas. First, we more rigorously analyze the two-phase spin-block algorithm and show that spin time should be increased when a process is receiving messages. Second, we present performance measurements for a wide range of synthetic benchmarks and for seven Split-C parallel applications. Finally, we show how implicit coscheduling behaves under different job layouts and scaling, and discuss preliminary results for achieving fairness.Keywords
This publication has 15 references indexed in Scilit:
- Effective distributed scheduling of parallel workloads1996
- Fast parallel sorting under LogP: experience with the CM-5IEEE Transactions on Parallel and Distributed Systems, 1996
- Coscheduling based on runtime identification of activity working setsInternational Journal of Parallel Programming, 1995
- Myrinet: a gigabit-per-second local area networkIEEE Micro, 1995
- A case for NOW (Networks of Workstations)IEEE Micro, 1995
- Parallel programming in Split-C1993
- Distributed computing feasibility in a non-dedicated homogeneous distributed system1993
- Models and algorithms for coscheduling compute-intensive taks on a network of workstationsJournal of Parallel and Distributed Computing, 1992
- Active messages1992
- Empirical studies of competitve spinning for a shared-memory multiprocessor1991