Caribou
Authors:
Open Access
- 1 August 2017
- journal article
- Published by Association for Computing Machinery (ACM) in Proceedings of the VLDB Endowment
- Vol. 10 (11) , 1202-1213
Abstract
The ever increasing amount of data being handled in data centers causes an intrinsic inefficiency: moving data around is expensive in terms of bandwidth, latency, and power consumption, especially given the low computational complexity of many database operations. In this paper we explore near-data processing in database engines, i.e., the option of offloading part of the computation directly to the storage nodes. We implement our ideas in Caribou, an intelligent distributed storage layer incorporating many of the lessons learned while building systems with specialized hardware. Caribou provides access to DRAM/NVRAM storage over the network through a simple key-value store interface, with each storage node providing high-bandwidth near-data processing at line rate and fault tolerance through replication. The result is a highly efficient, distributed, intelligent data storage that can be used to both boost performance and reduce power consumption and real estate usage in the data center thanks to the micro-server architecture adopted.Keywords
This publication has 38 references indexed in Scilit:
- Parallelizing Data Processing on FPGAs with Shifter ListsACM Transactions on Reconfigurable Technology and Systems, 2015
- A Hash Table for Line-Rate Data ProcessingACM Transactions on Reconfigurable Technology and Systems, 2015
- Flexible query processor on FPGAsProceedings of the VLDB Endowment, 2013
- Workload analysis of a large-scale key-value storeACM SIGMETRICS Performance Evaluation Review, 2012
- Complex event detection at wire speed with FPGAsProceedings of the VLDB Endowment, 2010
- The case for RAMCloudsACM SIGOPS Operating Systems Review, 2010
- H-storeProceedings of the VLDB Endowment, 2008
- Active disksACM SIGPLAN Notices, 1998
- Active pagesACM SIGARCH Computer Architecture News, 1998
- A universal algorithm for sequential data compressionIEEE Transactions on Information Theory, 1977