TraStrainer: Adaptive Sampling for Distributed Traces with System Runtime State
Open Access
- 12 July 2024
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Software Engineering
- Vol. 1 (FSE) , 473-493
Abstract
Distributed tracing has been widely adopted in many microservice systems and plays an important role in monitoring and analyzing the system. However, trace data often come in large volumes, incurring substantial computational and storage costs. To reduce the quantity of traces, trace sampling has become a prominent topic of discussion, and several methods have been proposed in prior work. To attain higher-quality sampling outcomes, biased sampling has gained more attention compared to random sampling. Previous biased sampling methods primarily considered the importance of traces based on diversity, aiming to sample more edge-case traces and fewer common-case traces. However, we contend that relying solely on trace diversity for sampling is insufficient, system runtime state is another crucial factor that needs to be considered, especially in cases of system failures. In this study, we introduce TraStrainer, an online sampler that takes into account both system runtime state and trace diversity. TraStrainer employs an interpretable and automated encoding method to represent traces as vectors. Simultaneously, it adaptively determines sampling preferences by analyzing system runtime metrics. When sampling, it combines the results of system-bias and diversity-bias through a dynamic voting mechanism. Experimental results demonstrate that TraStrainer can achieve higher quality sampling results and significantly improve the performance of downstream root cause analysis (RCA) tasks. It has led to an average increase of 32.63% in Top-1 RCA accuracy compared to four baselines in two datasets.Keywords
Funding Information
- Guangdong Basic and Applied Basic Research Foundation (No.2023B1515020054)
This publication has 33 references indexed in Scilit:
- Localizing and Explaining Faults in Microservices Using Distributed Tracing2022
- Sieve: Attention-based Sampling of End-to-End Trace Data in Distributed Microservice Systems2021
- Practical Root Cause Localization for Microservice Systems via Trace Analysis2021
- T-Rank:A Lightweight Spectrum based Fault Localization Approach for Microservice Systems2021
- MicroHECL: High-Efficient Root Cause Localization in Large-Scale Microservice Systems2021
- Unsupervised Detection of Microservice Trace Anomalies through Service-Level Deep Bayesian Networks2020
- Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) networkPhysica D: Nonlinear Phenomena, 2020
- Anomaly Detection from System Tracing Data Using Multimodal Deep Learning2019
- Microscope: Pinpoint Performance Issues with Causal Graphs in Micro-service Environments2018
- Some Implementations of the BoxplotThe American Statistician, 1989