Exploiting Hybrid Index Scheme for RDMA-based Key-Value Stores
Open Access
- 5 June 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 49-59
Abstract
RDMA (Remote Direct Memory Access) is widely studied in building key-value stores to achieve ultra-low latency. In RDMA-based key-value stores, the indexing time takes a large fraction of the overall operation latency as RDMA enables fast data access. However, the single index structure used in existing RDMA-based key-value stores, either hash-based or sorted index, fails to support range queries efficiently while achieving high performance for singlepoint operations. In this paper, we explore the adoption of a hybrid index in the key-value stores based on RDMA, especially under the memory disaggregation architecture, to combine the benefits of a hash table and a sorted index. We propose HStore, an RDMA-based key-value store that uses a hash table for single-point lookups and leverages a skiplist for range queries to index the values stored in the memory pool. Guided by previous work on using RDMA for key-value services, HStore dedicatedly chooses different RDMA verbs to optimize the read and write performance. To efficiently keep the index structures within a hybrid index consistent, HStore asynchronously applies the updates to the sorted index by shipping the update log via two-sided verbs. Compared to state-of-the-art Sherman and Clover, HStore improves the throughput by up to 54.5% and 38.5% respectively under the YCSB benchmark.Keywords
This publication has 4 references indexed in Scilit:
- Nessie: A Decoupled, Client-Driven Key-Value Store Using RDMAIEEE Transactions on Parallel and Distributed Systems, 2017
- The end of a mythProceedings of the VLDB Endowment, 2017
- Benchmarking cloud serving systems with YCSB2010
- Consistent hashing and random trees1997