LogBase
Authors:
Open Access
- 1 June 2012
- journal article
- Published by Association for Computing Machinery (ACM) in Proceedings of the VLDB Endowment
- Vol. 5 (10) , 1004-1015
Abstract
Numerous applications such as financial transactions (e.g., stock trading) are write-heavy in nature. The shift from reads to writes in web applications has also been accelerating in recent years. Write-ahead-logging is a common approach for providing recovery capability while improving performance in most storage systems. However, the separation of log and application data incurs write overheads observed in write-heavy environments and hence adversely affects the write throughput and recovery time in the system. In this paper, we introduce LogBase -- a scalable log-structured database system that adopts log-only storage for removing the write bottleneck and supporting fast system recovery. It is designed to be dynamically deployed on commodity clusters to take advantage of elastic scaling property of cloud environments. LogBase provides in-memory multiversion indexes for supporting efficient access to data maintained in the log. LogBase also supports transactions that bundle read and write operations spanning across multiple records. We implemented the proposed system and compared it with HBase and a disk-based log-structured record-oriented system modeled after RAMCloud. The experimental results show that LogBase is able to provide sustained write throughput, efficient data access out of the cache, and effective system recovery.Keywords
This publication has 23 references indexed in Scilit:
- Scalable SQL and NoSQL data storesACM SIGMOD Record, 2011
- CassandraACM SIGOPS Operating Systems Review, 2010
- Making snapshot isolation serializableACM Transactions on Database Systems, 2005
- The LHAM log-structured history data access methodThe VLDB Journal, 2000
- Distributed optimistic concurrency control methods for high-performance transaction processingIEEE Transactions on Knowledge and Data Engineering, 1998
- The log-structured merge-tree (LSM-tree)Acta Informatica, 1996
- ARIESACM Transactions on Database Systems, 1992
- The design and implementation of a log-structured file systemACM Transactions on Computer Systems, 1992
- Efficient locking for concurrent operations on B-treesACM Transactions on Database Systems, 1981
- The Recovery Manager of the System R Database ManagerACM Computing Surveys, 1981