Octopus-Man: QoS-driven task management for heterogeneous multicores in warehouse-scale computers
Authors:
- 1 February 2015
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15300897,p. 246-258
Abstract
Heterogeneous multicore architectures have the potential to improve energy efficiency by integrating power-efficient wimpy cores with high-performing brawny cores. However, it is an open question as how to deliver energy reduction while ensuring the quality of service (QoS) of latency-sensitive web-services running on such heterogeneous multicores in warehouse-scale computers (WSCs). In this work, we first investigate the implications of heterogeneous multicores in WSCs and show that directly adopting heterogeneous multicores without re-designing the software stack to provide QoS management leads to significant QoS violations. We then present Octopus-Man, a novel QoS-aware task management solution that dynamically maps latency-sensitive tasks to the least power-hungry processing resources that are sufficient to meet the QoS requirements. Using carefully-designed feedback-control mechanisms, Octopus-Man addresses critical challenges that emerge due to uncertainties in workload fluctuations and adaptation dynamics in a real system. Our evaluation using web-search and memcached running on a real-system Intel heterogeneous prototype demonstrates that Octopus-Man improves energy efficiency by up to 41% (CPU power) and up to 15% (system power) over an all-brawny WSC design while adhering to specified QoS targets.Keywords
This publication has 47 references indexed in Scilit:
- SMiTe: Precise QoS Prediction on Real-System SMT Processors to Improve Utilization in Warehouse Scale Computers2014
- Protean Code: Achieving Near-Free Online Code Transformations for Warehouse Scale Computers2014
- Scale-out processorsACM SIGARCH Computer Architecture News, 2012
- System-level integrated server architectures for scale-out datacenters2011
- Capping the brown energy consumption of Internet services at low cost2010
- Bias scheduling in heterogeneous multi-core architectures2010
- Power Management of Datacenter Workloads Using Per-Core Power GatingIEEE Computer Architecture Letters, 2009
- Feedback Control Architecture and Design Methodology for Service Delay Guarantees in Web ServersIEEE Transactions on Parallel and Distributed Systems, 2006
- Niagara: A 32-Way Multithreaded Sparc ProcessorIEEE Micro, 2005
- Single-ISA heterogeneous multi-core architectures: the potential for processor power reduction2003