Bench4Q: A QoS-Oriented E-Commerce Benchmark
Authors:
- Wenbo ZhangWZWenbo Zhang
- Sa WangSWSa Wang
- Wei WangWWWei Wang
- Hua ZhongHZHua Zhong
- 1 July 2011
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 07303157,p. 38-47
Abstract
E-commerce systems are typically QoS-sensitive, so QoS-oriented tunings of e-commerce servers are very important for such systems. However, existing e-commerce benchmarks are insufficient for supporting QoS-oriented tunings, because some critical QoS features of e-commerce systems cannot be precisely evaluated by them. One example of these features is the integrality of service, which is usually expressed as a session, provided to customers. This paper presents a QoS-oriented e-commerce benchmark, which is named Bench4Q and is an extension of TPC-W supporting QoS-oriented tuning of e-commerce servers. The main features of Bench4Q include: (1) supporting session-based metrics analysis and (2) simulating QoS-sensitive load for QoS-oriented capacity analysis. We illustrate the promising benefits of these features for QoS-oriented tuning of an e-commerce server by a series of Bench4Q benchmarking on a typical e-commerce server.Keywords
This publication has 23 references indexed in Scilit:
- Towards characterizing cloud backend workloadsACM SIGMETRICS Performance Evaluation Review, 2010
- CROWNBench: A Grid Performance Testing System Using Customizable Synthetic Workload2008
- A model-based approach for testing the performance of web applications2006
- Empirical Characterization of Session–Based Workload and Reliability for Web ServersEmpirical Software Engineering, 2006
- Measuring and characterizing end-to-end Internet service performanceACM Transactions on Internet Technology, 2003
- Size-based scheduling to improve web performanceACM Transactions on Computer Systems, 2003
- TPC-W e-commerce benchmark evaluationComputer, 2003
- TPC-W: a benchmark for e-commerceIEEE Internet Computing, 2002
- Business-oriented resource management policies for e-commerce serversPerformance Evaluation, 2000
- Web server workload characterizationACM SIGMETRICS Performance Evaluation Review, 1996