Abstract
Large-scale datacenters often host latency-sensitive services that have stringent Quality-of-Service requirement and experience diurnal load pattern. Co-locating them with best-effort applications that have no QoS requirement has been widely used to improve the resource utilization. However, existing co-location techniques tend to result in power overload problem on power constrained servers. To this end, we propose Sturgeon, which proactively manages resources between co-located applications in a power constrained environment, to ensure the QoS of latency-sensitive services while maximizing the throughput of best-effort applications. Our investigation shows that, at a given load, multiple feasible resource configurations exist and meet both QoS requirement and power budget. To find a feasible configuration with maximum throughput, we establish models to predict the performance and power consumption of the co-located applications. Besides, when the datacenter hosts different types of applications to perform co-location, Sturgeon places applications with their preferable candidates to improve the overall throughput. The experimental results show that at server level Sturgeon improves the throughput of the best-effort application by 25.43% compared to the state-of-the-art technique, while guaranteeing the 95%-ile latency within the QoS target; at cluster level, Sturgeon improves the overall throughput of best-effort applications by 13.74% compared to the baseline.
Funding Information
  • National R&D Program of China (2018YFB1004800)
  • National Natural Science Foundation of China (61632017, 61772480, 61872240, 61832006, 61702328)

This publication has 42 references indexed in Scilit: