High-Fidelity Per-Flow Delay Measurements With Reference Latency Interpolation
Authors:
- 10 December 2012
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ACM Transactions on Networking
- Vol. 21 (5) , 1567-1580
Abstract
New applications such as soft real-time data center applications, algorithmic trading, and high-performance computing require extremely low latency (in microseconds) from networks. Network operators today lack sufficient fine-grain measurement tools to detect, localize, and repair delay spikes that cause application service level agreement (SLA) violations. A recently proposed solution called LDA provides a scalable way to obtain latency, but only provides aggregate measurements. However, debugging application-specific problems requires per-flow measurements since different flows may exhibit significantly different characteristics even when they are traversing the same link. To enable fine-grained per-flow measurements in routers, we propose a new scalable architecture called reference latency interpolation (RLI) that is based on our observation that packets potentially belonging to different flows that are closely spaced to each other exhibit similar delay properties. In our evaluation using simulations over real traces, we show that while having small overhead, RLI achieves a median relative error of 12% and one to two orders of magnitude higher accuracy than previous per-flow measurement solutions. We also observe RLI achieves as high accuracy as LDA in aggregate latency estimation, and RLI outperforms LDA in standard deviation estimation.Keywords
This publication has 25 references indexed in Scilit:
- Data center TCP (DCTCP)2010
- Towards Unbiased End-to-End Network DiagnosisIEEE/ACM Transactions on Networking, 2009
- Safe and effective fine-grained TCP retransmissions for datacenter communication2009
- A Geometric Approach to Improving Active Packet Loss MeasurementIEEE/ACM Transactions on Networking, 2008
- Accurate and efficient SLA compliance monitoringACM SIGCOMM Computer Communication Review, 2007
- The power of slicing in internet flow measurement2005
- Building a better NetFlow2004
- Bridging router performance and queuing theory2004
- Measurement and analysis of single-hop delay on an IP backbone networkIEEE Journal on Selected Areas in Communications, 2003
- Wide area traffic: the failure of Poisson modelingIEEE/ACM Transactions on Networking, 1995