Interpretable Failure Localization for Microservice Systems Based on Graph Autoencoder
Top Cited Papers
Open Access
- 20 January 2025
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Software Engineering and Methodology
- Vol. 34 (2) , 1-28
Abstract
Accurate and efficient localization of root cause instances in large-scale microservice systems is of paramount importance. Unfortunately, prevailing methods face several limitations. Notably, some recent methods rely on supervised learning which necessitates a substantial amount of labeled data. However, labeling root cause instances is time-consuming and laborious, especially with multiple modalities of data including logs, traces, metrics, and so on. Moreover, some approaches favor deep learning for localization but lack interpretability and continuous improvement mechanisms. To address the above challenges, we propose DeepHunt , a novel root cause localization method based on multimodal data analysis. Firstly, DeepHunt introduces root cause score (RCS) by integrating reconstruction errors and failure propagation patterns (upstream–downstream relationships), imparting interpretability to the localization of root causes. Then, it embraces graph autoencoder (GAE) to address the limitation imposed by scarce labeled data. It employs data augmentation to mitigate the adverse effects of insufficient historical training samples. We evaluate DeepHunt on two open source datasets, and it outperforms existing methods when facing a zero-label cold start. DeepHunt can be further improved by continuously fine-tuning through a feedback mechanism.Keywords
This publication has 45 references indexed in Scilit:
- Eadro: An End-to-End Troubleshooting Framework for Microservices on Multi-source Data2023
- AID: Efficient Prediction of Aggregated Intensity of Dependency in Large-scale Cloud Systems2021
- Diagnosing Performance Issues in Microservices with Heterogeneous Data Source2021
- Practical Root Cause Localization for Microservice Systems via Trace Analysis2021
- MicroHECL: High-Efficient Root Cause Localization in Large-Scale Microservice Systems2021
- Fast Outage Analysis of Large-Scale Production Clouds with Service Correlation Mining2021
- Unsupervised Detection of Microservice Trace Anomalies through Service-Level Deep Bayesian Networks2020
- Localizing Failure Root Causes in a Microservice through Causality Inference2020
- Microscope: Pinpoint Performance Issues with Causal Graphs in Micro-service Environments2018
- Dimensionality Reduction by Learning an Invariant Mapping2006