Energy proportionality and workload consolidation for latency-critical applications
Authors:
Open Access
- 27 August 2015
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 342-355
Abstract
Energy proportionality and workload consolidation are important objectives towards increasing efficiency in large-scale datacenters. Our work focuses on achieving these goals in the presence of applications with μs-scale tail latency requirements. Such applications represent a growing subset of datacenter workloads and are typically deployed on dedicated servers, which is the simplest way to ensure low tail latency across all loads. Unfortunately, it also leads to low energy efficiency and low resource utilization during the frequent periods of medium or low load. We present the OS mechanisms and dynamic control needed to adjust core allocation and voltage/frequency settings based on the measured delays for latency-critical workloads. This allows for energy proportionality and frees the maximum amount of resources per server for other background applications, while respecting service-level objectives. Monitoring hardware queue depths allows us to detect increases in queuing latencies. Carefully coordinated adjustments to the NIC's packet redirection table enable us to reassign flow groups between the threads of a latency-critical application in milliseconds without dropping or reordering packets. We compare the efficiency of our solution to the Pareto-optimal frontier of 224 distinct static configurations. Dynamic resource control saves 44%--54% of processor energy, which corresponds to 85%--93% of the Pareto-optimal upper bound. Dynamic resource control also allows background jobs to run at 32%--46% of their standalone throughput, which corresponds to 82%--92% of the Pareto bound.Keywords
Funding Information
- NSF (CNS-1422088)
This publication has 34 references indexed in Scilit:
- Heracles2015
- Quality-of-Service-Aware Scheduling in Heterogeneous Data centers with ParagonIEEE Micro, 2014
- The tail at scaleCommunications of the ACM, 2013
- Chronos2012
- The PowerNap Server ArchitectureACM Transactions on Computer Systems, 2011
- NapSACACM SIGCOMM Computer Communication Review, 2011
- Wikipedia workload analysis for decentralized hostingComputer Networks, 2009
- Beyond Server ConsolidationQueue, 2008
- Scheduler activationsACM Transactions on Computer Systems, 1992
- Hashed and hierarchical timing wheels: data structures for the efficient implementation of a timer facilityACM SIGOPS Operating Systems Review, 1987