Telepathy: A Lightweight Silent Data Access Protocol for NVRAM+RDMA Enabled Distributed Storage
- 17 June 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computers
- Vol. 72 (3) , 839-852
Abstract
Recent developments in non-volatile memory and networking technologies raise new challenges and opportunities for architecting storage systems. In this paper we propose Telepathy, a lightweight data access protocol for NVRAM+RDMA-based distributed storage systems. Telepathy is a fully distributed protocol whose I/O writes can be coordinated by any server node, and I/O reads can be served by any of the replicas. Telepathy guarantees strongly-consistent reads while providing high I/O concurrency. Hybrid RDMA operations are used to transmit data directly and efficiently to the NVRAM of target servers. The correctness of Telepathy is verified with a formal proof of consistency, and its performance is validated with YCSB benchmarks on the Chameleon cluster. Telepathy can achieve low I/O latencies and high throughput, with low CPU utilization.Keywords
This publication has 16 references indexed in Scilit:
- Ouroboros Wear Leveling for NVRAM Using Hierarchical Block MigrationACM Transactions on Storage, 2017
- Distributed shared persistent memory2017
- Fast and general distributed transactions using RDMA and HTM2016
- Fast in-memory transaction processing using RDMA and HTM2015
- Mojim2015
- A Performance Study to Guide RDMA Programming Decisions2012
- CassandraACM SIGOPS Operating Systems Review, 2010
- DynamoACM SIGOPS Operating Systems Review, 2007
- Linearizability: a correctness condition for concurrent objectsACM Transactions on Programming Languages and Systems, 1990
- Hash Table MethodsACM Computing Surveys, 1975