Interactive Log Parsing via Light-weight User Feedback
Open Access
- 30 April 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1960-1968
Abstract
Template mining is one of the foundational tasks to support log analysis, which supports the diagnosis and troubleshooting of large scale Web applications. This paper develops a human-in-the-loop template mining framework to support interactive log analysis, which is highly desirable in real-world diagnosis or troubleshooting of Web applications but yet previous template mining algorithms fail to support it. We formulate three types of light-weight user feedback and based on them we design three atomic human-in-the-loop template mining algorithms. We derive mild conditions under which the outputs of our proposed algorithms are provably correct. We also derive upper bounds on the computational complexity and query complexity of each algorithm. We demonstrate the versatility of our proposed algorithms by combining them to improve the template mining accuracy of five representative algorithms over sixteen widely used benchmark datasets.Keywords
All Related Versions
Funding Information
- RGC?s GRF (14200321)
- Alibaba Innovative Research (ATA50DHZ4210003)
- Chongqing Talents: Exceptional Young Talents Project (cstc2021ycjhbgzxm0195)
This publication has 24 references indexed in Scilit:
- A search-based approach for accurate identification of log message formats2018
- DeepLog2017
- Drain: An Online Log Parsing Approach with Fixed Depth Tree2017
- Syslog processing for switch failure diagnosis and prediction in datacenter networks2017
- Spell: Streaming Parsing of System Event Logs2016
- LogMine2016
- Abstracting log lines to log event types for mining software system logs2010
- Clustering event logs using iterative partitioning2009
- Sublinear approximate string matching and biological applicationsAlgorithmica, 1994
- The String-to-String Correction ProblemJournal of the ACM, 1974