Efficient Distributed Coordination at WAN-Scale
Authors:
- Ailidani AilijiangAAAilidani Ailijiang
- Aleksey CharapkoACAleksey Charapko
- Murat DemirbasMDMurat Demirbas
- Bekir O. TurkkanBTBekir O. Turkkan
- Tevfik KosarTKTevfik Kosar
- 1 June 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636927,p. 1575-1585
Abstract
Traditional coordination services for distributed applications do not scale well over wide-area networks (WAN): centralized coordination fails to scale with respect to the increasing distances in the WAN, and distributed coordination fails to scale with respect to the number of nodes involved. We argue that it is possible to achieve scalability over WAN using a hierarchical coordination architecture and a smart token migration mechanism, and lay down the foundation of a novel design for a flexible-consistent coordination framework, called WanKeeper. We implemented WanKeeper based on the ZooKeeper API and deployed it over WAN as a proof of concept. Our experimental results based on the Yahoo! Cloud Serving Benchmark (YCSB), Apache BookKeeper replicated log service, and the Shared Cloud-backed File System (SCFS) show that WanKeeper provides multiple folds improvement in write/update performance in WAN compared to ZooKeeper, while keeping the same read performance.Keywords
This publication has 20 references indexed in Scilit:
- GIRAFFE: A scalable distributed coordination service for large-scale systems2014
- There is more consensus in Egalitarian parliaments2013
- Tango2013
- Durability with BookKeeperACM SIGOPS Operating Systems Review, 2013
- Calvin2012
- Don't settle for eventual2011
- Can a Decentralized Metadata Service Layer Benefit Parallel Filesystems?2011
- Benchmarking cloud serving systems with YCSB2010
- The Hadoop Distributed File System2010
- Token coherence2003