Token Account Algorithms: The Best of the Proactive and Reactive Worlds
Authors:
- Gabor DannerGDGabor Danner
- Mark JelasityMJMark Jelasity
- 1 July 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 885-895
Abstract
Many decentralized algorithms allow both proactive and reactive implementations. Examples include gossip protocols for broadcasting and decentralized computing, as well as chaotic matrix iteration algorithms. In proactive systems, nodes communicate at a fixed rate in regular intervals, while in reactive systems they communicate in response to certain events such as the arrival of fresh data. Although reactive algorithms tend to stabilize/converge/self-heal much faster, they have serious drawbacks: they may cause bursts in bandwidth consumption, and they may also cause starvation when the number of messages circulating in the system becomes too low. Proactive algorithms do not have these problems, but nodes waste a lot of time sitting on fresh information. Here, we propose a novel family of adaptive protocols that apply rate limiting inspired by the token bucket algorithm to prevent bursts, but they also include proactive communication to prevent starvation. With the help of our traffic shaping service, some applications approach the speed of the reactive implementation, while maintaining strong guarantees regarding the total communication cost and burstiness. Due to the proactive component we can help maintain a certain level of activity despite losing messages due to faults or the application semantics. We perform simulation experiments in different scenarios including a real smartphone availability trace. Our results suggest up to a fourfold speedup in a broadcast application, and an order of magnitude speedup in the case of gossip learning, when compared to the purely proactive implementation.Keywords
This publication has 13 references indexed in Scilit:
- Defining and understanding smartphone churn over the internet: A measurement study2014
- Gossip learning with linear models on fully distributed dataConcurrency and Computation: Practice and Experience, 2012
- Stochastic Gradient Descent Tricks2012
- Boosting Gossip for Live Streaming2010
- PeerSim: A scalable P2P simulator2009
- Cloud control with distributed rate limiting2007
- Gossip-based peer samplingACM Transactions on Computer Systems, 2007
- Proactive replication in distributed storage systems using machine availability estimation2007
- Adaptive gossip-based broadcast2004
- A chaotic asynchronous algorithm for computing the fixed point of a nonnegative matrix of unit spectral radiusJournal of the ACM, 1986