Interactive Log Parsing via Light-weight User Feedbacks
Authors:
Preprint
Abstract
Template mining is one of the foundational tasks to support log analysis, which supports the diagnosis and troubleshooting of large scale Web applications. This paper develops a human-in-the-loop template mining framework to support interactive log analysis, which is highly desirable in real-world diagnosis or troubleshooting of Web applications but yet previous template mining algorithms fails to support it. We formulate three types of light-weight user feedbacks and based on them we design three atomic human-in-the-loop template mining algorithms. We derive mild conditions under which the outputs of our proposed algorithms are provably correct. We also derive upper bounds on the computational complexity and query complexity of each algorithm. We demonstrate the versatility of our proposed algorithms by combining them to improve the template mining accuracy of five representative algorithms over sixteen widely used benchmark datasets.Keywords
All Related Versions
This publication has 7 references indexed in Scilit:
- SemParser: A Semantic Parser for Log Analytics2023
- FlexParser—The adaptive log file parser for continuous results in a changing worldJournal of Software: Evolution and Process, 2022
- Efficient Online Log Parsing with Log Punctuations SignatureApplied Sciences, 2021
- A Survey on Automated Log Analysis for Reliability EngineeringACM Computing Surveys, 2021
- Logram: Efficient Log Parsing Using n-Gram DictionariesIEEE Transactions on Software Engineering, 2020
- Syslog processing for switch failure diagnosis and prediction in datacenter networks2017
- Sublinear approximate string matching and biological applicationsAlgorithmica, 1994