GIRAFFE: A scalable distributed coordination service for large-scale systems
Authors:
- 1 September 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15525244,p. 38-47
Abstract
The scale of cloud services keeps increasing over time, significantly introducing huge challenges in system manageability and reliability. Designing coordination services in cloud is the right track to solve the above problems. However, existing coordination services (e.g., Chubby and ZooKeeper) only perform well in read-intensive scenario and small ensemble scales. To this end, we propose Giraffe, a scalable distributed coordination service. There are three important contributions in our design. (1) Giraffe organizes coordination servers using interior-node-disjoint trees for better scalability. (2) Giraffe employs a novel Paxos protocol for strong consistency and fault-tolerance. (3) Giraffe supports hierarchical data organization and in-memory storage for high throughput and low latency. We evaluate Giraffe on a high performance computing test-bed. The experimental results show that Giraffe gains much better write performance than ZooKeeper when server ensemble is large. Giraffe is nearly 300% faster than ZooKeeper on update operations when ensemble size is 50 servers. Experiments also show that Giraffe reacts and recovers more quickly than ZooKeeper against node failures.Keywords
This publication has 14 references indexed in Scilit:
- There is more consensus in Egalitarian parliaments2013
- Multi-Ring Paxos2012
- Availability Of JobTracker Machine In Hadoop/MapReduce Zookeeper Coordinated ClustersAdvanced Computing: An International Journal, 2012
- Scalable consistency in Scatter2011
- High performance state-machine replication2011
- Zab: High-performance broadcast for primary-backup systems2011
- BitDew: A programmable environment for large-scale data management and distribution2008
- Paxos made live2007
- Multicoordinated Paxos2007
- Fast PaxosDistributed Computing, 2006