A Space-Efficient Fair Cache Scheme Based on Machine Learning for NVMe SSDs
- 11 November 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Parallel and Distributed Systems
- Vol. 34 (1) , 383-399
Abstract
Non-volatile memory express (NVMe) solid-state drives (SSDs) have been widely adopted in multi-tenant cloud computing environments or multi-programming systems. The on-board DRAM cache inside NVMe SSDs can efficiently reduce the disk accesses and extend the lifetime of SSDs. Current SSD cache management research either improves cache hit ratio while ignoring fairness, or improves fairness while sacrificing overall performance. In this paper, we present MLCache, a space-efficient shared cache management scheme for NVMe SSDs. By learning the impact of reuse distance on cache allocation, a workload-generic neural network model is built. At runtime, MLCache continuously monitors the reuse distance distribution for the neural network module to obtain space-efficient allocation decisions. MLCache also proposes an efficient parallel writing back strategy based on hit ratio and response time, to improve fairness. Experimental results show MLCache improves the write hit ratio when compared to baseline, and MLCache strongly safeguards the fairness of SSDs with parallel write-back and maintains a low level of degradation.Keywords
Funding Information
- National Natural Science Foundation of China (61902136, 61932010)
- National Key Research and Development Program of China (2019YFB1705903)
- Hubei Provincial Natural Science Foundation of China (2019CFB119)
- Fundamental Research Funds for the Central Universities (2019kfyXJJS090)
This publication has 38 references indexed in Scilit:
- ViyojitACM SIGARCH Computer Architecture News, 2017
- Optimal Cache Partition-Sharing2015
- A Hybrid Non-Volatile Cache Design for Solid-State Drives Using Comprehensive I/O CharacterizationIEEE Transactions on Computers, 2015
- Dual region write buffering2015
- Talus: A simple way to remove cliffs in cache performance2015
- COLORIS2014
- PARDA: A Fast Parallel Reuse Distance Analysis Algorithm2012
- DFTLACM SIGPLAN Notices, 2009
- Enterprise SSDsQueue, 2008
- Artificial neural networks: fundamentals, computing, design, and applicationJournal of Microbiological Methods, 2000