An Approach to Pinpointing Bug-Induced Failure in Logs of Open Cloud Platforms
Authors:
- Jia TongJTJia Tong
- Li YingLYLi Ying
- Tang HongyanTHTang Hongyan
- Wu ZhonghaiWZWu Zhonghai
- 1 June 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 294-302
Abstract
Software bugs have been one of the dominant causes of system failures, especially in cloud systems based on open source platforms. One big challenge for troubleshooting these cloud systems is to pinpoint the software bug-induced failure in large and complex log files which is a nightmare for administrators. So far, there has been little study on how to identity bug-induced failures based on log analysis. In this paper, we analyze and describe features of bug-induced failure logs from bug repository and Q&A websites, and then propose a general automatic approach to pinpoint logs of bug-induced failure from log files of open cloud platform. In the approach, two algorithms called MPIN and SPIN are presented for log classification. We evaluate our approach by applying logs collected from bug repositories of OpenStack and Hadoop, and five Q&A websites. The experimental result shows that the proposed approach can identify logs of bug-induced failure in OpenStack logs with 83.9% precision, and for Hadoop logs with 82.52% precision.Keywords
This publication has 10 references indexed in Scilit:
- What Bugs Live in the Cloud? A Study of 3000+ Issues in Cloud Systems2014
- An Efficient Network Log Anomaly Detection System Using Random Projection Dimensionality Reduction2014
- ELT: Efficient Log-based Troubleshooting System for Cloud Computing Infrastructures2011
- Online System Problem Detection by Mining Patterns of Console Logs2009
- An analysis method for improving a bug modification process in open source software development2009
- Alert Detection in System Logs2008
- Online design bug detection: RTL analysis, flexible mechanisms, and evaluation2008
- Have things changed now?2006
- Fast string correction with Levenshtein automataInternational Journal on Document Analysis and Recognition (IJDAR), 2002
- Algorithm AS 136: A K-Means Clustering AlgorithmJournal of the Royal Statistical Society Series C: Applied Statistics, 1979