ZWAL: Rethinking Write-ahead Logs for ZNS SSDs with Zone Appends
Open Access
- 22 April 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 9-16
Abstract
KV-stores are extensively used databases that require performance stability. Zoned Namespace (ZNS) is an emerging interface for flash storage devices that provides such stability. Due to their sequential write access patterns, LSM trees, ubiquitous data structures in KV stores, present a natural fit for the append-only ZNS interface. However, LSM-trees achieve limited write throughput on ZNS. This limitation is because the largest portion of LSM-tree writes are small writes for the write-ahead log (WAL) component of LSM-trees, and ZNS has limited performance for small write I/O. The ZNS-specific zone append operation presents a solution, enhancing the throughput of small sequential writes. Still, zone appends are challenging to utilize in WALs. The storage device is allowed to reorder the data of zone appends, which is not supported by WAL recovery. Therefore, we need to change the WAL design to support such reordering. This paper introduces ZWALs, a new WAL design that uses zone appends to increase LSM-tree write throughput. They are resilient to reordering by adding identifiers to each append along with a novel recovery technique. We implement ZWALs in the state-of-the-art combination of RocksDB and ZenFS and report up to 8.56 times higher throughput on the YCSB benchmark. We open-source all our code at https://github.com/stonet-research/zwal.Keywords
Funding Information
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (OCENW.KLEIN.561 and OCENW.KLEIN.209)
This publication has 19 references indexed in Scilit:
- Performance Characterization of NVMe Flash Devices with Zoned Namespaces (ZNS)2023
- ZenFS+: Nurturing Performance and Isolation to ZenFSIEEE Access, 2023
- Lifetime-leveling LSM-tree compaction for ZNS SSD2022
- Understanding modern storage APIs2022
- RocksDB: Evolution of Development Priorities in a Key-value Store Serving Large-scale ApplicationsACM Transactions on Storage, 2021
- The Unwritten Contract of Solid State Drives2017
- ReFlexACM SIGARCH Computer Architecture News, 2017
- Flash storage disaggregation2016
- An efficient design and implementation of LSM-tree based key-value store on open-channel SSD2014
- Benchmarking cloud serving systems with YCSB2010