On the necessity of explicit cross-layer data formats in near-data processing systems
Open Access
- 16 March 2021
- journal article
- research article
- Published by Springer Nature in Distributed and Parallel Databases
- Vol. 40 (1) , 27-45
Abstract
Massive data transfers in modern data-intensive systems resulting from low data-locality and data-to-code system design hurt their performance and scalability. Near-Data processing (NDP) and a shift to code-to-data designs may represent a viable solution as packaging combinations of storage and compute elements on the same device has become feasible. The shift towards NDP system architectures calls for revision of established principles. Abstractions such as data formats and layouts typically spread multiple layers in traditional DBMS, the way they are processed is encapsulated within these layers of abstraction. The NDP-style processing requires an explicit definition of cross-layer data formats and accessors to ensure in-situ executions optimally utilizing the properties of the underlying NDP storage and compute elements. In this paper, we make the case for such data format definitions and investigate the performance benefits under RocksDB and the COSMOS hardware platform.Keywords
Funding Information
- Bundesministerium für Forschung, Technologie und Raumfahrt (01IS18081C, 01IS18081D)
- Deutsche Forschungsgemeinschaft (419942270)
- HAW Promotion, MWK, Baden-Würrtembgerg, Germany
- Technische Universität Darmstadt
This publication has 21 references indexed in Scilit:
- Data Blocks2016
- In-storage processing of database scans and joinsInformation Sciences, 2016
- Beyond the Wall2015
- DB2 with BLU accelerationProceedings of the VLDB Endowment, 2013
- Query processing on smart SSDs2013
- Less watts, more performance2013
- Enabling cost-effective data processing with smart SSD2013
- Minerva: Accelerating Data Analysis in Next-Generation SSDs2013
- Active disks1998
- A case for intelligent disks (IDISKs)ACM SIGMOD Record, 1998