ART: A Unified Unsupervised Framework for Incident Management in Microservice Systems
Open Access
- 27 October 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1183-1194
Abstract
Automated incident management is critical for large-scale microservice systems, including tasks such as anomaly detection (AD), failure triage (FT), and root cause localization (RCL). Currently, most techniques focus only on a single task, overlooking shared knowledge across closely related tasks. However, employing isolated models for managing multiple tasks may result in inefficiencies, delayed responses, a lack of systemic perspective, and complexity in updates and operations. Therefore we propose ART, an unsupervised framework that integrates a full-process solution covering Anomaly detection, failure Triage, and Root cause localization. It reaches the unification of multiple tasks by extracting the shared knowledge. Specifically, we first conduct an empirical study to analyze how the shared knowledge embedded in anomalous deviations manifests in AD, FT, and RCL. To better calculate deviations and extract shared knowledge, we sequentially model channel, temporal, and call dependencies using Transformer Encoder, GRU, and GraphSAGE, respectively. Then unified failure representations enhance the interpretability of abstract features with explicit semantic information, serving as the basis for unsupervised multitask solutions. Our evaluations on the datasets generated from two benchmark microservice systems demonstrate that ART outperforms existing methods in terms of AD (improving by 5.65% to 60.8%), FT (improving by 13.2% to 95.7%), and RCL (improving by 13.3% to 205%).Keywords
Funding Information
- Advanced Research Project of China (31511010501)
- National Natural Science Foundation of China (62272249, 62302244, 62072264)
This publication has 43 references indexed in Scilit:
- Twin Graph-Based Anomaly Detection via Attentive Multi-Modal Learning for Microservice System2023
- Heterogeneous Anomaly Detection for Software Systems via Semi-supervised Cross-modal Attention2023
- MicroHECL: High-Efficient Root Cause Localization in Large-Scale Microservice Systems2021
- Semi-Supervised Log-Based Anomaly Detection via Probabilistic Label Estimation2021
- Anomaly Detection from System Tracing Data Using Multimodal Deep Learning2019
- An Approach to Cloud Execution Failure Diagnosis Based on Exception Logs in OpenStack2019
- Mining Historical Test Logs to Predict Bugs and Localize Faults in the Test Logs2019
- Densely Connected Convolutional Networks2017
- Context Encoders: Feature Learning by Inpainting2016
- Learning Deep Features for Discriminative Localization2016