A Machine Learning-Empowered Cache Management Scheme for High-Performance SSDs
- 22 May 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computers
- Vol. 73 (8) , 2066-2080
Abstract
NAND Flash-based solid-state drives (SSDs) have gained widespread usage in data storage thanks to their exceptional performance and low power consumption. The computational capability of SSDs has been elevated to tackle complex algorithms. Inside an SSD, a DRAM cache for frequently accessed requests reduces response time and write amplification (WA), thereby improving SSD performance and lifetime. Existing caching schemes, based on temporal locality, overlook its variations, which potentially reduces cache hit rates. Some caching schemes bolster performance via flash-aware techniques but at the expense of the cache hit rate. To address these issues, we propose a random forest machine learning Classifier-empowered Cache scheme named CCache, where I/O requests are classified into critical, intermediate, and non-critical ones according to their access status. After designing a machine learning model to predict these three types of requests, we implement a trie-level linked list to manage the cache placement and replacement. CCache safeguards critical requests for cache service to the greatest extent, while granting the highest priority to evicting request accessed by non-critical requests. CCache – considering chip state when processing non-critical requests – is implemented in an SSD simulator (SSDSim). CCache outperforms the alternative caching schemes, including LRU, CFLRU, LCR, NCache, ML_WP, and CCache_ANN, in terms of response time, WA, erase count, and hit ratio. The performance discrepancy between CCache and the OPT scheme is marginal. For example, CCache reduces the response time of the competitors by up to 41.9% with an average of 16.1%. CCache slashes erase counts by a maximum of 67.4%, with an average of 21.3%. The performance gap between CCache and and OPT is merely 2.0%-3.0%.Keywords
Funding Information
- National Natural Science Foundation of China (61702001)
- U.S. National Science Foundation (IIS-1618669, OAC-1642133, CCF-0845257)
This publication has 16 references indexed in Scilit:
- DAC: A dynamic active and collaborative cache management scheme for solid state disksJournal of Systems Architecture, 2023
- Cache-MAB: A reinforcement learning-based hybrid caching scheme in named data networksFuture Generation Computer Systems, 2023
- Adaptive Management With Request Granularity for DRAM Cache Inside nand-Based SSDsIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2022
- NCache: A Machine-Learning Cache Management Scheme for Computational SSDsIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2022
- Self-Adapting Channel Allocation for Multiple Tenants Sharing SSD DevicesIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2021
- ECR: Eviction‐cost‐aware cache management policy for page‐level flash‐based SSDsConcurrency and Computation: Practice and Experience, 2019
- TRANSFORM-ANN for online optimization of complex industrial processes: Casting process as case studyEuropean Journal of Operational Research, 2018
- A Hybrid Non-Volatile Cache Design for Solid-State Drives Using Comprehensive I/O CharacterizationIEEE Transactions on Computers, 2015
- Retention Trimming for Lifetime Improvement of Flash Memory Storage SystemsIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2015
- Error Model Guided Joint Performance and Endurance Optimization for Flash MemoryIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2014