CauseInfer: Automatic and distributed performance diagnosis with hierarchical causality graph in large distributed systems
Authors:
Top Cited Papers
- 1 April 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 0743166X,p. 1887-1895
Abstract
Modern applications especially cloud-based or cloud-centric applications always have many components running in the large distributed environment with complex interactions. They are vulnerable to suffer from performance or availability problems due to the highly dynamic runtime environment such as resource hogs, configuration changes and software bugs. In order to make efficient software maintenance and provide some hints to software bugs, we build a system named CauseInfer, a low cost and blackbox cause inference system without instrumenting the application source code. CauseInfer can automatically construct a two layered hierarchical causality graph and infer the causes of performance problems along the causal paths in the graph with a series of statistical methods. According to the experimental evaluation in the controlled environment, we find out CauseInfer can achieve an average 80% precision and 85% recall in a list of top two causes to identify the root causes, higher than several state-of-the-art methods and a good scalability to scale up in the distributed systems.Keywords
This publication has 13 references indexed in Scilit:
- FChain: Toward Black-Box Online Fault Localization for Cloud Systems2013
- CloudPD: Problem determination and diagnosis in shared dynamic clouds2013
- Mining program workflow from interleaved traces2010
- Fingerprinting the datacenter2010
- Execution Anomaly Detection in Distributed Systems through Unstructured Log Analysis2009
- Automated anomaly detection and performance modeling of enterprise applicationsACM Transactions on Computer Systems, 2009
- Detecting large-scale system problems by mining console logs2009
- Fa: A System for Automating Failure DiagnosisInternational Conference on Data Engineering, 2009
- Answering what-if deployment and configuration questions with wiseACM SIGCOMM Computer Communication Review, 2008
- Pinpoint: problem determination in large, dynamic Internet services2003