Analytic modeling of multitier Internet applications
Authors:
Open Access
- 1 May 2007
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on the Web
- Vol. 1 (1)
Abstract
Since many Internet applications employ a multitier architecture, in this article, we focus on the problem of analytically modeling the behavior of such applications. We present a model based on a network of queues where the queues represent different tiers of the application. Our model is sufficiently general to capture (i) the behavior of tiers with significantly different performance characteristics and (ii) application idiosyncrasies such as session-based workloads, tier replication, load imbalances across replicas, and caching at intermediate tiers. We validate our model using real multitier applications running on a Linux server cluster. Our experiments indicate that our model faithfully captures the performance of these applications for a number of workloads and configurations. Furthermore, our model successfully handles a comprehensive range of resource utilization---from 0 to near saturation for the CPU---for two separate tiers. For a variety of scenarios, including those with caching at one of the application tiers, the average response times predicted by our model were within the 95% confidence intervals of the observed average response times. Our experiments also demonstrate the utility of the model for dynamic capacity provisioning, performance prediction, bottleneck identification, and session policing. In one scenario, where the request arrival rate increased from less than 1500 to nearly 4200 requests/minute, a dynamic provisioning technique employing our model was able to maintain response time targets by increasing the capacity of two of the tiers by factors of 2 and 3.5, respectively.Keywords
This publication has 27 references indexed in Scilit:
- SoftUDC: a software-based data center for utility computingComputer, 2004
- Pricing-based strategies for autonomic control of web servers for time-varying request arrivalsEngineering Applications of Artificial Intelligence, 2004
- Web server software architecturesIEEE Internet Computing, 2003
- Web servers under overload: How scheduling can help2003
- Performance guarantees for Web server end-systems: a control-theoretical approachIEEE Transactions on Parallel and Distributed Systems, 2002
- Session-based admission control: a mechanism for peak load management of commercial Web sitesIEEE Transactions on Computers, 2002
- Overload Control Mechanisms for Web Servers2001
- Web content adaptation to improve server overload behaviorComputer Networks, 1999
- The Method of LayersIEEE Transactions on Software Engineering, 1995
- Mean-Value Analysis of Closed Multichain Queuing NetworksJournal of the ACM, 1980