Protean: Adaptive Management of Shared-Memory in Datacenter Switches
- 17 May 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-10
Abstract
Datacenters rely on high-bandwidth networks that use inexpensive, shared-buffer switches. The combination of high bandwidth, bursty traffic patterns, and shallow buffers imply that switch buffer is a heavily contended resource and intelligent management of shared buffers among competing traffic (ports, traffic classes) becomes an important challenge. Dynamic Threshold (DT), which is the current state-of-the-art in buffer management, provides either high bandwidth utilization with poor burst absorption or good burst absorption with inferior utilization, but not both. We present Protean, which dynamically identifies bursty traffic and allocates more buffer space accordingly—Protean provides more space to queues that experience transient load spikes by observing the gradient of queue length but does not cause persistent unfairness as the gradient cannot continue to remain high in shallow buffered switches for long periods of time. We implemented Protean in today’s programmable switches and demonstrate their high performance with negligible overhead. Our at-scale ns-3 simulations show that Protean reduces the tail latency by a factor of 5 over DT on average across varying loads with realistic workloads.Keywords
This publication has 25 references indexed in Scilit:
- Packet-Level Telemetry in Large Datacenter Networks2015
- TIMELY2015
- Inside the Social Network's (Datacenter) Network2015
- Pingmesh2015
- pFabric2013
- Forwarding metamorphosis2013
- Controlling Queue DelayQueue, 2012
- Sizing router buffers2004
- Dynamic queue length thresholds for shared-memory packet switchesIEEE/ACM Transactions on Networking, 1998
- Random early detection gateways for congestion avoidanceIEEE/ACM Transactions on Networking, 1993