Statistical techniques for online anomaly detection in data centers
Authors:
- 1 May 2011
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15730077,p. 385-392
Abstract
Online anomaly detection is an important step in data center management, requiring light-weight techniques that provide sufficient accuracy for subsequent diagnosis and management actions. This paper presents statistical techniques based on the Tukey and Relative Entropy statistics, and applies them to data collected from a production environment and to data captured from a testbed for multi-tier web applications running on server class machines. The proposed techniques are lightweight and improve over standard Gaussian assumptions in terms of performance.Keywords
This publication has 11 references indexed in Scilit:
- Anomaly detectionACM Computing Surveys, 2009
- Towards highly reliable enterprise network services via inference of multi-level dependenciesACM SIGCOMM Computer Communication Review, 2007
- E2EProf: Automated End-to-End Performance Management for Enterprise Systems2007
- SysProf: Online Distributed Behavior Diagnosis through Fine-grain System Monitoring2006
- An improved data stream summary: the count-min sketch and its applicationsJournal of Algorithms, 2005
- Pinpoint: problem determination in large, dynamic Internet services2003
- Performance and scalability of EJB applications2002
- Elements of Information Theory2001
- Ten Lectures on Wavelets1992
- A theory for multiresolution signal decomposition: the wavelet representationIEEE Transactions on Pattern Analysis and Machine Intelligence, 1989