HyScale: Hybrid and Network Scaling of Dockerized Microservices in Cloud Data Centres
Authors:
- 1 July 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 80-90
Abstract
When designing modern software, care must be taken to allow for applications to scale based on the demands of its users while still accommodating flexibility in development. Recently, microservices architectures have garnered the attention of many organizations—providing higher levels of scalability, availability, and fault isolation. Many organizations choose to host their microservices architectures in cloud data centres to offset costs. Incidentally, data centres become over-encumbered during peak usage hours and underutilized during off-peak hours. Traditional microservice scaling methods perform either horizontal or vertical scaling exclusively. When used in combination, however, these methods offer complementary benefits and compensate for each other's deficiencies. To leverage the high availability of horizontal scaling and the fine-grained resource control of vertical scaling, we developed two novel hybrid autoscaling algorithms and a dedicated network scaling algorithm and benchmarked them against Google's popular Kubernetes horizontal autoscaling algorithm. Results indicated up to 1.49x speedups in response times for our hybrid algorithms, and 1.69x speedups for our network algorithm under high-burst network loads.Keywords
This publication has 17 references indexed in Scilit:
- Autonomic Vertical Elasticity of Docker Containers with ELASTICDOCKER2017
- Automatic memory-based vertical elasticity and oversubscription on cloud platformsFuture Generation Computer Systems, 2016
- Four-Fold Auto-Scaling on a Contemporary Deployment Platform Using Docker Containers2015
- An updated performance comparison of virtual machines and Linux containers2015
- Application-driven dynamic vertical scaling of virtual machines in resource pools2014
- Enabling cost-aware and adaptive elasticity of multi-tier cloud applicationsFuture Generation Computer Systems, 2014
- A cost-aware auto-scaling approach using the workload prediction in service cloudsInformation Systems Frontiers, 2013
- Apache Hadoop YARN2013
- SmartScale: Automatic Application Scaling in Enterprise Clouds2012
- Cloud computing: state-of-the-art and research challengesJournal of Internet Services and Applications, 2010