GELog: a GPT-Enhanced Log Representation Method for Anomaly Detection
Authors:
- 27 April 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 524-535
Abstract
Log anomaly detection is a critical aspect of Artificial Intelligence for IT Operations (AIOps), as it enables the timely identification of system failures, thereby facilitating program understanding throughout the entire software maintenance and engineering life cycles. While existing methods only leverage raw log information for anomaly detection, they struggle to address challenges such as log differences due to log evolution, noise from log parsing, and stylistic differences between logs and natural language. To overcome these limitations, we propose GELog, an innovative log anomaly detection method. Specifically, GELog initially employs GPT to semantically enhance log templates. Subsequently, it extracts semantic vectors using pretrained sentence-bert and introduces an attention-based semantic fusion module that integrates the semantic representations of both the original and enhanced logs. Finally, GELog utilizes a Transformer-based model for anomaly detection. We evaluated the performance of GELog on four publicly available datasets, and the experimental results demonstrate that GELog significantly enhances the semantic representation of logs, achieving superior anomaly detection performance.Keywords
This publication has 23 references indexed in Scilit:
- LogGPT: Exploring ChatGPT for Log-Based Anomaly Detection2023
- TwinNet: Twin Structured Knowledge Transfer Network for Weakly Supervised Action LocalizationMachine Intelligence Research, 2022
- Log-based Anomaly Detection Without Log Parsing2021
- Semi-Supervised Log-Based Anomaly Detection via Probabilistic Label Estimation2021
- Learning-Based Anomaly Cause Tracing with Synthetic Analysis of Logs from Multiple Cloud Service Components2019
- Detecting Anomaly in Big Data System Logs Using Convolutional Neural Network2018
- An Integrated Method for Anomaly Detection From Massive System LogsIEEE Access, 2018
- Drain: An Online Log Parsing Approach with Fixed Depth Tree2017
- What Supercomputers Say: A Study of Five System Logs2007
- Failure diagnosis using decision trees2004