Management of Next-Generation NAND Flash to Achieve Enterprise-Level Endurance and Latency Targets
Authors:
Open Access
- 30 November 2018
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Storage
- Vol. 14 (4) , 1-25
Abstract
Despite its widespread use in consumer devices and enterprise storage systems, NAND flash faces a growing number of challenges. While technology advances have helped to increase the storage density and reduce costs, they have also led to reduced endurance and larger block variations, which cannot be compensated solely by stronger ECC or read-retry schemes but have to be addressed holistically. Our goal is to enable low-cost NAND flash in enterprise storage for cost efficiency. We present novel flash-management approaches that reduce write amplification, achieve better wear leveling, and enhance endurance without sacrificing performance. We introduce block calibration, a technique to determine optimal read-threshold voltage levels that minimize error rates, and novel garbage-collection as well as data-placement schemes that alleviate the effects of block health variability and show how these techniques complement one another and thereby achieve enterprise storage requirements. By combining the proposed schemes, we improve endurance by up to 15× compared to the baseline endurance of NAND flash without using a stronger ECC scheme. The flash-management algorithms presented herein were designed and implemented in simulators, hardware test platforms, and eventually in the flash controllers of production enterprise all-flash arrays. Their effectiveness has been validated across thousands of customer deployments since 2015.Keywords
This publication has 28 references indexed in Scilit:
- Performance of garbage collection algorithms for flash-based solid state drives with hot/cold dataPerformance Evaluation, 2013
- Improving flash write performance by using update frequencyProceedings of the VLDB Endowment, 2013
- A mean field model for a class of garbage collection algorithms in flash-based solid state drivesACM SIGMETRICS Performance Evaluation Review, 2013
- The tail at scaleCommunications of the ACM, 2013
- Performance of greedy garbage collection in flash-based solid-state drivesPerformance Evaluation, 2010
- Competitive Analysis of Flash-Memory Algorithms2006
- Algorithms and data structures for flash memoriesACM Computing Surveys, 2005
- Real-time garbage collection for flash-memory storage systems of real-time embedded systemsACM Transactions on Embedded Computing Systems, 2004
- An Age-Threshold Algorithm for Garbage Collection in Log-Structured Arrays and File Systems1998
- The design and implementation of a log-structured file systemACM Transactions on Computer Systems, 1992