Optimal Routing to Parallel Servers in Heavy Traffic
Author:
- 1 January 2025
- journal article
- research article
- Published by Institute for Operations Research and the Management Sciences (INFORMS) in Operations Research
- Vol. 73 (1) , 483-509
Abstract
Routing control is an important component in many engineering and management systems consisting of multiple and possibly heterogeneous servers. Imagine that upon the arrival of each job (or customer), a controller will evaluate the available (dynamic) state information and make a decision to dispatch the job to one of the servers. The state information can be queue length, arrival history, service history, and so on, depending on the nature of the application. How will the controller use the available state information to minimize the average waiting time an arriving job may experiences? In the paper, “Optimal Routing to Parallel Servers in Heavy Traffic,” Ye carries out the heavy traffic analysis to identify the routing policies that best use the available state information. For example, when there is no state information available for routing control, the best “blind” strategy is to dispatch the incoming jobs in a weighted round-robin fashion that exhibits certain form of the square-root rule. Although in the case that the job arrival history is available, the controller should use the information by closely chasing a kind of “arrival deviation,” which can reduce up to 50% of the waiting time compared with the best blind strategy. This study sheds new insights into the value of state information for routing control and provides new tools for engineering and service system design.Keywords
This publication has 63 references indexed in Scilit:
- Validity of heavy traffic steady-state approximations in generalized Jackson networksThe Annals of Applied Probability, 2006
- OPTIMAL ROUTING IN OUTPUT-QUEUED FLEXIBLE SERVER SYSTEMSProbability in the Engineering and Informational Sciences, 2005
- Scheduling a multi class queue with many exponential servers: asymptotic optimality in heavy trafficThe Annals of Applied Probability, 2004
- MaxWeight scheduling in a generalized switch: State space collapse and workload minimization in heavy trafficThe Annals of Applied Probability, 2004
- Heavy traffic analysis of a system with parallel servers: asymptotic optimality of discrete-review policiesThe Annals of Applied Probability, 1998
- Stability and convergence of moments for multiclass queueing networks via fluid limit modelsIEEE Transactions on Automatic Control, 1995
- Heavy traffic limit theorems for a sequence of shortest queueing systemsQueueing Systems, 1995
- On Positive Harris Recurrence of Multiclass Queueing Networks: A Unified Approach Via Fluid Limit ModelsThe Annals of Applied Probability, 1995
- Optimality of the round-robin routing policyJournal of Applied Probability, 1994
- Dynamic routing in open queueing networks: Brownian models, cut constraints and resource poolingQueueing Systems, 1993