Trace Sampling 2.0: Code Knowledge Enhanced Span-level Sampling for Distributed Tracing
Authors:
- Yulun WuYWYulun Wu
- Guangba YuGYGuangba Yu
- Zhihan JiangZJZhihan Jiang
- Yichen LiYLYichen Li
- Michael R. LyuMLMichael R. Lyu
Preprint
Abstract
Distributed tracing is an essential diagnostic tool in microservice systems, but the sheer volume of traces places a significant burden on backend storage. A common approach to mitigating this issue is trace sampling, which selectively retains traces based on specific criteria, often preserving only anomalous ones. However, this method frequently discards valuable information, including normal traces that are essential for comparative analysis. To address this limitation, we introduce Trace Sampling 2.0, which operates at the span level while maintaining trace structure consistency. This approach allows for the retention of all traces while significantly reducing storage overhead. Based on this concept, we design and implement Autoscope, a span-level sampling method that leverages static analysis to extract execution logic, ensuring that critical spans are preserved without compromising structural integrity. We evaluated Autoscope on two open-source microservices. Our results show that it reduces trace size by 81.2% while maintaining 98.1% faulty span coverage, outperforming existing trace-level sampling methods. Furthermore, we demonstrate its effectiveness in root cause analysis, achieving an average improvement of 8.3%. These findings indicate that Autoscope can significantly enhance observability and storage efficiency in microservices, offering a robust solution for performance monitoring.Keywords
All Related Versions
This publication has 42 references indexed in Scilit:
- Towards LLM-Assisted System Testing for Microservices2024
- Tracemesh: Scalable and Streaming Sampling for Distributed Traces2024
- Eadro: An End-to-End Troubleshooting Framework for Microservices on Multi-source Data2023
- Sieve: Attention-based Sampling of End-to-End Trace Data in Distributed Microservice Systems2021
- Scalable Statistical Root Cause Analysis on App Telemetry2021
- Unsupervised Detection of Microservice Trace Anomalies through Service-Level Deep Bayesian Networks2020
- A Real-Time Trace-Level Root-Cause Diagnosis System in Alibaba DatacentersIEEE Access, 2019
- An Analysis of Holistic Tail Latency Behaviors of Java Microservices2019
- Predicting the End-to-End Tail Latency of Containerized Microservices in the Cloud2019
- Interprocedural Control Flow AnalysisLecture Notes in Computer Science, 1999