LoWAR: Enhancing RDMA over Lossy WANs with Transparent Error Correction
Authors:
- 19 June 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-10
Abstract
As the increase of geographically distributed applications continues, the demand for high-speed, long-distance data transmission across wide area networks (WANs) has significantly increased. Remote Direct Memory Access (RDMA) is extensively deployed in data center networks (DCNs) for its high throughput, low latency, and reduced CPU utilization, and its extension to WANs is expected to fully leverage these benefits. However, existing RDMA solutions, while demonstrating superior performance in data centers, face a performance gap over WANs due to their reliance on DCNs for optimal performance and lack of optimization for WANs’ high latency and loss rates. To bridge this gap, we introduce Lossy Wide-Area RDMA (LoWAR), a high-goodput, high-reliability RDMA solution for lossy WANs. LoWAR incorporates a forward error correction (FEC) shim layer to protect RDMA messages from packet loss, thus minimizing the inefficiency of retransmissions. It also fully offloads processing to RNICs with minimal computational overhead and storage burden, operating transparently on RNICs without requiring modifications to existing applications and networks. We implement a LoWAR prototype with FPGA and evaluate its performance through testbed experiments. The results demonstrate LoWAR’s enhanced performance in lossy WANs: in WANs with 40ms RTT and 0.001% to 0.01% loss rates, LoWAR increases RDMA goodput by 2.05 to 5.01 times, reduces average flow completion times (FCTs) by 3.5% to 12.2%, and eliminates 99th percentile tail FCTs in most scenarios.Keywords
Funding Information
- National Science Foundation
This publication has 28 references indexed in Scilit:
- BiCC: Bilateral Congestion Control in Cross-datacenter RDMA Networks2024
- Bifrost: Extending RoCE for Long Distance Inter-DC Links2023
- rQUIC: Integrating FEC with QUIC for Robust Wireless Communications2019
- Congestion Control for Cross-Datacenter Networks2019
- Nem: Toward Fine-grained Load Balancing through RNIC EC Offloading2018
- WA-Dataspaces: Exploring the Data Staging Abstractions for Wide-Area Distributed Scientific Workflows2017
- Optical Performance Monitoring: A Review of Current and Future TechnologiesJournal of Lightwave Technology, 2015
- Evaluating High Performance Data Transfer with RDMA-based Protocols in Wide-Area Networks2012
- Designing Efficient FTP Mechanisms for High Performance Data-Transfer over InfiniBand2009
- Lateness probability of a retransmission scheme for error control on a two-state Markov channelIEEE Transactions on Communications, 1999