Qingzhen Ma
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Qingzhen Ma has a total of 5 co-authors. Here are the top co-authors by number of shared publications:
- Jian Zhang
National Supercomputer Center in Tianjin, Tianjin, China
1 shared publication - Jinghua Feng
National Supercomputer Center in Tianjin, Tianjin, China
1 shared publication - Liquan Xiao
College of Computer Science and Technology, National University of Defense Technology
1 shared publication - Yuan Yuan
National university of defense technology, Changsha, China
1 shared publication - Yuqi Li
National University of Defense Technology, Changsha, China and National Supercomputer Center in Tianjin, Tianjin, China
1 shared publication
Latest Publications
- Open Access
- 17 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 34-37
AutoLAD: An Unsupervised Anomaly Detection Method for Supercomputer Logs
Ensuring the reliability of the supercomputer is challenging. A potential solution could be to detect anomalies in a timely manner from the logs. However, current methods struggle with the vast diversity and volume of Exascale supercomputer logs due to the heavy reliance on manual labeling. This paper introduces AutoLAD, an unsupervised log anomaly detection method. Firstly, logs are embedded using a pre-trained language model. AutoLAD then creates a basic set of standard log patterns utilizing the Local Outlier Factor algorithm to remove anomalous entries. Finally, AutoLAD employs a single-log sliding-window strategy to handle the standard set, forming the autoencoder’s training set, which enables the learning of standard patterns. In the detection stage, the autoencoder evaluates a fixed-length log sequence. If the reconstruction error exceeds a set threshold, the sequence is deemed anomalous. Our approach, tested on logs from the NG-Tianhe supercomputer, achieved an F1 score of more than 0.91.
- 17 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 34-37
Open AccessAutoLAD: An Unsupervised Anomaly Detection Method for Supercomputer Logs
Ensuring the reliability of the supercomputer is challenging. A potential solution could be to detect anomalies in a timely manner from the logs. However, current methods struggle with the vast diversity and volume of Exascale supercomputer logs due to the heavy reliance on manual labeling. This paper introduces AutoLAD, an unsupervised log anomaly detection method. Firstly, logs are embedded using a pre-trained language model. AutoLAD then creates a basic set of standard log patterns utilizing the Local Outlier Factor algorithm to remove anomalous entries. Finally, AutoLAD employs a single-log sliding-window strategy to handle the standard set, forming the autoencoder’s training set, which enables the learning of standard patterns. In the detection stage, the autoencoder evaluates a fixed-length log sequence. If the reconstruction error exceeds a set threshold, the sequence is deemed anomalous. Our approach, tested on logs from the NG-Tianhe supercomputer, achieved an F1 score of more than 0.91.