Modeling Performance of Microservices Systems with Growth Theory
Open Access
- 11 January 2022
- journal article
- research article
- Published by Springer Nature in Empirical Software Engineering
- Vol. 27 (2) , 1-44
Abstract
Context: The microservices architectural style is gaining momentum in the IT industry. This style does not guarantee that a target system can continuously meet acceptable performance levels. The ability to study the violations of performance requirements and eventually predict them would help practitioners to tune techniques like dynamic load balancing or horizontal scaling to achieve the resilience property.Objective: The goal of this work is to study the violations of performance requirements of microservices through time series analysis and provide practical instruments that can detect resilient and non-resilient microservices and possibly predict their performance behavior.Method: We introduce a new method based ongrowth theoryto model the occurrences of violations of performance requirements as a stochastic process. We applied our method to an in-vitro e-commerce benchmark and an in-production real-world telecommunication system. We interpreted the resulting growth models to characterize the microservices in terms of their transient performance behavior.Results: Our empirical evaluation shows that, in most of the cases, the non-linear S-shaped growth models capture the occurrences of performance violations of resilient microservices with high accuracy. The bounded nature associated with this models tell that the performance degradation is limited and thus the microservice is able to come back to an acceptable performance level even under changes in the nominal number of concurrent users. We also detect cases where linear models represent a better description. These microservices are not resilient and exhibit constant growth and unbounded performance violations over time. The application of our methodology to a real in-production system identified additional resilience profiles that were not observed in the in-vitro experiments. These profiles show the ability of services to react differently to the same solicitation. We found that when a service is resilient it can either decrease the rate of the violations occurrences in a continuous manner or with repeated attempts (periodical or not).Conclusions: We showed that growth theory can be successfully applied to study the occurences of performance violations of in-vitro and in-production real-world systems. Furthermore, the cost of our model calibration heuristics, based on the mathematical expression of the selected non-linear growth models, is limited. We discussed how the resulting models can shed some light on the trend of performance violations and help engineers to spot problematic microservice operations that exhibit performance issues. Thus, meaningful insights from the application of growth theory have been derived to characterize the behavior of (non) resilient microservices operations.Keywords
This publication has 57 references indexed in Scilit:
- Knowledge transfer in system modeling and its realization through an optimal allocation of information granularityApplied Soft Computing, 2012
- A Comparative Analysis of Open Source Software ReliabilityJournal of Software, 2010
- Performance evaluation of component-based software systems: A surveyPerformance Evaluation, 2010
- An evaluation of R2 as an inadequate measure for nonlinear models in pharmacological and biochemical research: a Monte Carlo approachBMC Pharmacology, 2010
- Nonlinear Regression Analysis2010
- Open source software reliability modelACM SIGSOFT Software Engineering Notes, 2005
- Empirical evaluation of defect projection models for widely-deployed production software systemsACM SIGSOFT Software Engineering Notes, 2004
- Predicting software reliabilityComputer, 1996
- Estimating the parameters of a non-homogeneous Poisson-process model for software reliabilityIEEE Transactions on Reliability, 1993
- Software Reliability1990