Automatic Parsing and Utilization of System Log Features in Log Analysis: A Survey
Open Access
- 14 April 2023
- journal article
- review article
- Published by MDPI AG in Applied Sciences
- Vol. 13 (8) , 4930
Abstract
System logs are almost the only data that records system operation information, so they play an important role in anomaly analysis, intrusion detection, and situational awareness. However, it is still a challenge to obtain effective data from massive system logs. On the one hand, system logs are unstructured data, and, on the other hand, system log records cannot be directly analyzed and calculated by computers. In order to deal with these problems, current researchers digitize system logs through two key steps of log parsing and feature extraction. This paper classifies, analyzes, and summarizes the current log analysis research in terms of log parsing and feature extraction by investigating articles in recent years (including ICSE, TKDD, ICDE, IJCAI, ISSRE, ICDM, ICWS, ICSME, etc.). Finally, in combination with the existing research, the research prospects in the field are elaborated and predicted.Keywords
This publication has 64 references indexed in Scilit:
- Neural Network-based Graph Embedding for Cross-Platform Binary Code Similarity Detection2017
- Drain: An Online Log Parsing Approach with Fixed Depth Tree2017
- A Markov Random Field Based Approach for Analyzing Supercomputer System LogsIEEE Transactions on Cloud Computing, 2017
- Spell: Streaming Parsing of System Event Logs2016
- LogMine2016
- Experience Report: System Log Analysis for Anomaly Detection2016
- node2vec2016
- LogCluster - A data clustering and pattern mining algorithm for event logs2015
- LINE2015
- DeepWalk2014