LogEncoder: Log-Based Contrastive Representation Learning for Anomaly Detection
- 25 January 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Network and Service Management
- Vol. 20 (2) , 1378-1391
Abstract
In recent years, cloud computing centers have grown rapidly in size. Analyzing system logs is an important way for the quality of service monitoring. However, systems produce massive amounts of logs, and it is impractical to analyze them manually. Automatic and accurate log analysis to detect abnormal events in systems has become extremely important. However, due to the nature of the log analysis problem, such as discrete property, class imbalance, and quality of log, log-based anomaly detection remains a difficult problem. To address these challenges, we propose LogEncoder, a framework of log sequence encoding for semi-supervised anomaly detection. LogEncoder utilizes a pre-trained model to obtain a semantic vector for each log event. To separate normal and abnormal log event sequences and preserve their contextual information, we integrate one-class and contrastive learning objectives training into the representation model. Finally, we propose two methods, one for offline and one for online, to detect system anomalies. Compared to six state-of-the-art baselines on three benchmark datasets, LogEncoder outperforms five unsupervised and semi-supervised methods, and the performance is comparable to the supervised method LogRobust.Keywords
Funding Information
- National Natural Science Foundation of China (Grant No. 61732002, Grant No. 62072018)
This publication has 38 references indexed in Scilit:
- DeepLog2017
- O-CNNACM Transactions on Graphics, 2017
- Drain: An Online Log Parsing Approach with Fixed Depth Tree2017
- Spell: Streaming Parsing of System Event Logs2016
- Experience Report: System Log Analysis for Anomaly Detection2016
- Proactive failure detection learning generation patterns of large-scale network logs2015
- Spatio-temporal decomposition, clustering and identification for alert detection in system logs2012
- Fingerprinting the datacenter2010
- What Supercomputers Say: A Study of Five System Logs2007
- Density-Induced Support Vector Data DescriptionIEEE Transactions on Neural Networks, 2007