SkyByte: Architecting an Efficient Memory-Semantic CXL-based SSD with OS and Hardware Co-design
Authors:
- 1 March 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 577-593
Abstract
The CXL-based solid-state drive (CXL-SSD) provides a promising approach towards scaling the main memory capacity at low cost. However, the CXL-based SSD faces performance challenges due to the long flash access latency and unpredictable events such as garbage collection in the SSD device, stalling the host processor and wasting compute cycles. Although the CXL interface enables the byte-granular data access to the SSD, accessing flash chips is still at page granularity due to physical limitations. The mismatch of access granularity causes significant unnecessary I/O traffic to flash chips, worsening the suboptimal end-to-end data access performance. In this paper, we present SkyByte, an efficient CXL-based SSD that employs a holistic approach to address the aforementioned challenges by co-designing the host operating system (OS) and SSD controller. To alleviate the long memory stall when accessing the CXL-SSD, SkyByte revisits the OS context switch mechanism and enables opportunistic context switches upon the detection of long access delays. To accommodate byte-granular data accesses, SkyByte architects the internal DRAM of the SSD controller into a cacheline-level write $\log$ and a page-level data cache, and enables data coalescing upon log cleaning to reduce the I/O traffic to flash chips. SkyByte also employs optimization techniques that include adaptive page migration for exploring the performance benefits of fast host memory by promoting hot pages in CXL-SSD to the host. We implement SkyByte with a CXL-SSD simulator and evaluate its efficiency with various data-intensive applications. Our experiments show that SkyByte outperforms current CXL-based SSD by $6.11 \times$, and reduces the I/O traffic to flash chips by $\mathbf{2 3. 0 8} \times$ on average. SkyByte also reaches $\mathbf{7 5 \%}$ of the performance of the ideal case that assumes unlimited DRAM capacity in the host, which offers an attractive cost-effective solution.
Keywords
All Related Versions
This publication has 35 references indexed in Scilit:
- AstriFlash A Flash-Based System for Online Services2023
- HOOP: Efficient Hardware-Assisted Out-of-Place Update for Non-Volatile Memory2020
- Amber: Enabling Precise Full-System Simulation with Detailed Modeling of All SSD Resources2018
- 2B-SSD: The Case for Dual, Byte- and Block-Addressable Solid-State Drives2018
- Energy-Efficient Deep In-memory Architecture for NAND Flash Memories2018
- Solid-State-Drives (SSDs) Modeling2017
- Splash-3: A properly synchronized benchmark suite for contemporary research2016
- TAP: A TLP-aware cache management policy for a CPU-GPU heterogeneous architecture2012
- Rodinia: A benchmark suite for heterogeneous computing2009
- The Benchmark Suite2008