Combining Heuristic and Reinforcement Learning to Achieve the Low-latency and High-throughput Receiver-side Congestion Control
Preprint
Abstract
Traditional congestion control algorithms struggle to maintain the consistent and satisfactory data transmission performance over time-varying networking condition. Simultaneously, as video traffic becomes dominant, the loose coupling between the DASH framework and TCP congestion control results in the un-matched bandwidth usage, thereby limiting video streaming performance. To address these issues, this paper proposes a receiver-driven congestion control framework named Nuwa. Nuwa deploys the congestion avoidance phase at the receiver-side, utilizing one-way queueing delay detection to monitor network congestion and setting specific target delays for different applications. Experimental results demonstrate that, in most cases, with appropriate parameter configuration, Nuwa can improve the throughput of TCP flows 4% to 15.4% and reduce average queueing delay by 6.9% to 29.4%. Furthermore, we also introduce the use of reinforcement learning to dynamically adjust Nuwa's key parameter , enhancing Nuwa's adaptability to the unpredictable environment.Keywords
All Related Versions
This publication has 19 references indexed in Scilit:
- Glider: rethinking congestion control with deep reinforcement learningWorld Wide Web, 2022
- ABRaider: Multiphase Reinforcement Learning for Environment-Adaptive Video StreamingIEEE Access, 2022
- RBBR: A Receiver-Driven BBR in QUIC for Low-Latency in Cellular NetworksIEEE Access, 2022
- NexGen D-TCP: Next Generation Dynamic TCP Congestion Control AlgorithmIEEE Access, 2020
- Statistical Learning Based Congestion Control for Real-Time Video CommunicationIEEE Transactions on Multimedia, 2019
- End-to-End Simulation of 5G mmWave NetworksIEEE Communications Surveys & Tutorials, 2018
- Receiver-Side TCP Countermeasure to Bufferbloat in Wireless Access NetworksIEEE Transactions on Mobile Computing, 2015
- CUBIC-FIT: A High Performance and TCP CUBIC Friendly Congestion Control AlgorithmIEEE Communications Letters, 2013
- Understanding the Basis of the Kalman Filter Via a Simple and Intuitive Derivation [Lecture Notes]IEEE Signal Processing Magazine, 2012
- TCP Westwood: End-to-End Congestion Control for Wired/Wireless NetworksWireless Networks, 2002