DLogParser: An Efficient Dynamic Log Parser with Multiple Grouping Criteria
Open Access
- 13 January 2026
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 16 (2) , 811
Abstract
Most existing log parsers are static. When parsing logs with a static parser, the accuracy tends to fluctuate significantly. To overcome this issue, this paper proposes a dynamic log parser named DLogParser. The core idea of DLogParser is to select different parsing policies based on log features. DLogParser first parses a small batch of sample log messages, then analyzes log characteristics from the parsing results, and determines an appropriate parsing policy for the current logs. Then it parses all remaining logs according to the determined policy. To support dynamic parsing policies, DLogParser incorporates 5 grouping criteria for log features, including length, punctuation, first token, last token, and key token, and establishes 7 rules for parsing policy generation. We evaluated DLogParser on public datasets from LogHub. The experimental results demonstrate that compared to 11 existing log parsers, DLogParser achieves an accuracy of 90.3% with an acceptable performance loss.Keywords
Funding Information
- National Natural Science Foundation of China (61902427)
- Henan Provincial Key Scientific and Technological Research Project (252102210104)
This publication has 30 references indexed in Scilit:
- PosParser: A Heuristic Online Log Parsing Method Based on Part-of-Speech TaggingIEEE Transactions on Big Data, 2024
- HELP: Hierarchical Embeddings-based Log ParsingarXiv, 2024
- LILAC: Log Parsing using LLMs with Adaptive Parsing CacheProceedings of the ACM on Software Engineering, 2024
- LogRule: Efficient Structured Log Mining for Root Cause AnalysisIEEE Transactions on Network and Service Management, 2023
- Efficient Online Log Parsing with Log Punctuations SignatureApplied Sciences, 2021
- A Survey on Automated Log Analysis for Reliability EngineeringACM Computing Surveys, 2021
- Pathidea: Improving Information Retrieval-Based Bug Localization by Re-Constructing Execution Paths Using LogsIEEE Transactions on Software Engineering, 2021
- A Directed Acyclic Graph Approach to Online Log ParsingarXiv, 2018
- LogCluster - A data clustering and pattern mining algorithm for event logs2015
- Mining Frequent Patterns without Candidate Generation: A Frequent-Pattern Tree ApproachData Mining and Knowledge Discovery, 2004