RDMA-Enabled Concurrency Control Protocols for Transactions in the Cloud Era
- 29 September 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cloud Computing
- Vol. 11 (1) , 798-810
Abstract
Online transaction processing (OLTP) is widely used on modern cloud infrastructures to complete important businesses such as payments and stock exchanges. Remote Direct Memory Access (RDMA) is a technology that enables ultra-low inter-server memory access latency - which is critical for implementing high-performance concurrency control protocols in distributed OLTP. In this paper, we develop RCC, the first unified and comprehensive RDMA-enabled distributed transaction processing framework containing six serializable concurrency control protocolsnot only the classical protocols NOWAIT, WAITDIE, OCC, but also more advanced MVCC, SUNDIAL, and CALVIN the deterministic protocol. Our goal is to unbiasedly compare protocols on OLTP workloads in a common execution environment with the concurrency control protocol being the only changeable component. From RCC, we obtained new insights on building RDMA-based protocols. We analyzed stage-wise latency breakdown to develop more efficient hybrid implementations. Moreover, RCC can enumerate all stage-wise hybrid designs under a given workload characteristic. Our results show that throughput-wise hybrid designs are better than RPC or one-sided counterparts by 32.2% and up to 67%; three hybrid designs are better than their pure counterparts by up to 17.8%. RCC can provide performance insights and be used as the common open-source infrastructure for fast prototyping new implementations.Keywords
This publication has 32 references indexed in Scilit:
- Staring into the abyssProceedings of the VLDB Endowment, 2014
- Coordination avoidance in database systemsProceedings of the VLDB Endowment, 2014
- MaaTProceedings of the VLDB Endowment, 2014
- SchismProceedings of the VLDB Endowment, 2010
- A brief history of NTP timeACM SIGCOMM Computer Communication Review, 2003
- Coordinator log transaction execution protocolDistributed and Parallel Databases, 1993
- Concurrency control performance modeling: alternatives and implicationsACM Transactions on Database Systems, 1987
- Multiversion concurrency control—theory and algorithmsACM Transactions on Database Systems, 1983
- On optimistic methods for concurrency controlACM Transactions on Database Systems, 1981
- Concurrency Control in Distributed Database SystemsACM Computing Surveys, 1981