Workload-Aware Online Anomaly Detection in Enterprise Applications with Local Outlier Factor
Authors:
- 1 July 2012
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 07303157,p. 25-34
Abstract
Detecting anomalies are essential for improving the reliability of enterprise applications. Current approaches set thresholds for metrics or model correlations between metrics, and anomalies are detected when the thresholds are violated or the correlations are broken. However, we have found that the dynamic workload fluctuating over multiple time scales causes system metrics and their correlations to change. Moreover, it is difficult to model various metric correlations in complex applications. This paper addresses these problems and proposes an online anomaly detection approach for enterprise applications. A method is presented for recognizing workload patterns with an incremental clustering algorithm. The Local Outlier Factor (LOF) based on the specific workload pattern is adopted for detecting anomalies. Our approach is evaluated on a testbed running the TPC-W benchmark. The experimental results show that our approach can capture workload fluctuations accurately and detect the typical faults effectively.Keywords
This publication has 21 references indexed in Scilit:
- On the use of computational geometry to detect software faults at runtime2010
- System monitoring with metric-correlation models2009
- A comparative study of pairwise regression techniques for problem determinationProceedings of the 2007 conference of the center for advanced studies on Collaborative research - CASCON '07, 2007
- Modeling and Tracking of Transaction Flow Dynamics for Fault Detection in Complex SystemsIEEE Transactions on Dependable and Secure Computing, 2006
- Web Workload Characterization: Ten Years Later2005
- TPC-W: a benchmark for e-commerceIEEE Internet Computing, 2002
- Characterizing the scalability of a large web-based shopping systemACM Transactions on Internet Technology, 2001
- LOFACM SIGMOD Record, 2000
- A methodology for workload characterization of E-commerce sites1999
- The SR-tree1997