Detecting Abnormal Machine Characteristics in Cloud Infrastructures
Authors:
- Kanishka BhaduriKBKanishka Bhaduri
- Kamalika DasKDKamalika Das
- Bryan L. MatthewsBMBryan L. Matthews
- 1 December 2011
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 23759232,p. 137-144
Abstract
In the cloud computing environment resources are accessed as services rather than as a product. Monitoring this system for performance is crucial because of typical pay-per- use packages bought by the users for their jobs. With the huge number of machines currently in the cloud system, it is often extremely difficult for system administrators to keep track of all machines using distributed monitoring programs such as Ganglia1 which lacks system health assessment and summarization capabilities. To overcome this problem, we propose a technique for automated anomaly detection using machine performance data in the cloud. Our algorithm is entirely distributed and runs locally on each computing machine on the cloud in order to rank the machines in order of their anomalous behavior for given jobs. There is no need to centralize any of the performance data for the analysis and at the end of the analysis, our algorithm generates error reports, thereby allowing the system administrators to take corrective actions. Experiments performed on real data sets collected for different jobs validate the fact that our algorithm has a low overhead for tracking anomalous machines in a cloud infrastructure.Keywords
This publication has 10 references indexed in Scilit:
- Real-Time Identification of Performance Problems in Large Distributed Systems2011
- Algorithms for speeding up distance-based outlier detection2011
- An automatic intrusion diagnosis approach for cloudsInternational Journal of Automation and Computing, 2011
- Fingerprinting the datacenter2010
- VigilantACM SIGOPS Operating Systems Review, 2008
- Failure Detection in Large-Scale Internet Services by Principal Subspace MappingIEEE Transactions on Knowledge and Data Engineering, 2007
- AutopilotACM SIGOPS Operating Systems Review, 2007
- Mining for misconfigured machines in grid systems2006
- Fast Distributed Outlier Detection in Mixed-Attribute Data SetsData Mining and Knowledge Discovery, 2006
- Mining distance-based outliers in near linear time with randomization and a simple pruning rule2003