RStore: A Direct-Access DRAM-based Data Store
Authors:
- Animesh TrivediATAnimesh Trivedi
- Patrick StuediPSPatrick Stuedi
- Bernard MetzlerBMBernard Metzler
- Clemens LutzCLClemens Lutz
- Martin SchmatzMSMartin Schmatz
- Thomas R. GrossTGThomas R. Gross
- 1 June 2015
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 674-685
Abstract
Distributed DRAM stores have become an attractive option for providing fast data accesses to analytics applications. To accelerate the performance of these stores, researchers have proposed using RDMA technology. RDMA offers high bandwidth and low latency data access by carefully separating resource setup from IO operations, and making IO operations fast by using rich network semantics and offloading. Despite recent interest, leveraging the full potential of RDMA in a distributed environment remains a challenging task. In this paper, we present RDMA Store or RStore, a DRAM-based data store that delivers high performance by extending RDMA's separation philosophy to a distributed setting. RStore achieves high aggregate bandwidth (705 Gb/s) and close-to-hardware latency on our 12-machine testbed. We developed a distributed graph processing framework and a Key-Value sorter using RStore's unique memory-like API. The graph processing framework, which relies on RStore for low-latency graph access, outperforms state-of-the-art systems by margins of 2.6 -- 4.2× when calculating Page Rank. The Key-Value sorter can sort 256 GB of data in 31.7 sec, which is 8× better than Hadoop TeraSort in a similar setting.Keywords
This publication has 15 references indexed in Scilit:
- DaRPC2014
- jVerbs2013
- Trinity2013
- High performance RDMA-based design of HDFS over InfiniBand2012
- Memcached Design on High Performance RDMA Capable Interconnects2011
- Minimizing the Hidden Cost of RDMA2009
- Sinfonia2007
- Virtual memory mapped network interface for the SHRIMP multicomputer2002
- An implementation of the Hamlyn sender-managed interface architecture1996
- U-Net1995