SemParser: A Semantic Parser for Log Analytics
Authors:
- 1 May 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 881-893
Abstract
Logs, being run-time information automatically generated by software, record system events and activities with their timestamps. Before obtaining more insights into the run-time status of the software, a fundamental step of log analysis, called log parsing, is employed to extract structured templates and parameters from the semi-structured raw log messages. However, current log parsers are all syntax-based and regard each message as a character string, ignoring the semantic information included in parameters and templates. Thus, we propose the first semantic-based parser SemParser to unlock the critical bottleneck of mining semantics from log messages. It contains two steps, an end-to-end semantics miner and a joint parser. Specifically, the first step aims to identify explicit semantics inside a single log, and the second step is responsible for jointly inferring implicit semantics and computing structural outputs according to the contextual knowledge base of the logs. To analyze the effectiveness of our semantic parser, we first demonstrate that it can derive rich semantics from log messages collected from six widely-applied systems with an average F1 score of 0.985. Then, we conduct two representative downstream tasks, showing that current downstream models improve their performance with appropriately extracted semantics by 1.2%-11.7% and 8.65% on two anomaly detection datasets and a failure identification dataset, respectively. We believe these findings provide insights into semantically understanding log messages for the log analysis community.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62202511)
This publication has 39 references indexed in Scilit:
- Drain: An Online Log Parsing Approach with Fixed Depth Tree2017
- An Approach for Anomaly Diagnosis Based on Hybrid Graph Model with Logs for Distributed Services2017
- What Causes My Test Alarm? Automatic Cause Analysis for Test Alarms in System and Integration Testing2017
- An Unsupervised Neural Attention Model for Aspect Extraction2017
- Deep Neural Networks for YouTube Recommendations2016
- Speech recognition with deep recurrent neural networks2013
- LogSig2011
- Detecting large-scale system problems by mining console logs2009
- Failure diagnosis using decision trees2004
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960