Look Deep into the Microservice System Anomaly through Very Sparse Logs
Open Access
- 30 April 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 2970-2978
Abstract
Intensive monitoring and anomaly diagnosis have become a knotty problem for modern microservice architecture due to the dynamics of service dependency. While most previous studies rely heavily on ample monitoring metrics, we raise a fundamental but always neglected issue - the diagnostic metric integrity problem. This paper solves the problem by proposing MicroCU – a novel approach to diagnose microservice systems using very sparse API logs. We design a structure named dynamic causal curves to portray time-varying service dependencies and a temporal dynamics discovery algorithm based on Granger causal intervals. Our algorithm generates a smoother space of causal curves and designs the concept of causal unimodalization to calibrate the causality infidelities brought by missing metrics. Finally, a path search algorithm on dynamic causality graphs is proposed to pinpoint the root cause. Experiments on commercial system cases show that MicroCU outperforms many state-of-the-art approaches and reflects the superiorities of causal unimodalization to raw metric imputation.Keywords
Funding Information
- Science and Technology on Communication Networks Laboratory (6142104200103)
- CCF-Tencent Open Fund
- National Natural Science Foundation of China (62072006, 92167104)
- Qiyuan Lab Innovation Fund
This publication has 28 references indexed in Scilit:
- Fault Analysis and Debugging of Microservice Systems: Industrial Survey, Benchmark System, and Empirical StudyIEEE Transactions on Software Engineering, 2018
- Microscope: Pinpoint Performance Issues with Causal Graphs in Micro-service Environments2018
- CloudRanger: Root Cause Identification for Cloud Native Systems2018
- Sieve2017
- Root cause detection in a service-oriented architectureACM SIGMETRICS Performance Evaluation Review, 2013
- Bayesian probabilistic matrix factorization using Markov chain Monte Carlo2008
- Pinpoint: problem determination in large, dynamic Internet services2003
- Analyzing data sets with missing data: an empirical evaluation of imputation methods and likelihood-based methodsIEEE Transactions on Software Engineering, 2001
- Testing for unit roots in autoregressive-moving average models of unknown orderBiometrika, 1984
- Maximum Likelihood from Incomplete Data Via the EM AlgorithmJournal of the Royal Statistical Society Series B: Statistical Methodology, 1977