Low‐overhead inline deduplication for persistent memory
Authors:
- 12 August 2020
- journal article
- research article
- Published by Wiley in Transactions on Emerging Telecommunications Technologies
- Vol. 32 (8)
Abstract
Persistent memory (PM) can play an important role in storing the edge data of IoT devices, but their capacities are restrained by the embedded system, which only provides the limited host space and energy resource. Therefore, a deduplication system is required to improve the PM utilization and energy consumption. According to our observations, the current inline deduplication algorithms incur nonnegligible latency when applied to the PM file systems (PMFSs), mainly because (i) the low tolerance to the extra deduplication I/O path, (ii) the long fingerprint calculation, and (iii) the unnecessary duplication detection when writing content with low duplication ratio. To improve this issue, we propose LO‐Dedup, a novel and low‐overhead deduplication system for PM. LO‐Dedup adopts PM‐friendly design, both in fine‐grained data load/store and fast hash scheme to reduce overhead. Moreover, LO‐Dedup can adaptively sample duplication detection according to the recent contents. We implement a prototype of LO‐Dedup in PMFS, which is a well‐known PMFS. The experimental results show that the write performance only has a slight drop when writing data and saves up to 45% space in PMFS.Keywords
Funding Information
- National Natural Science Foundation of China (61972164, 61772211)
- Pearl River S and T Nova Program of Guangzhou Municipality (201710010189)
This publication has 21 references indexed in Scilit:
- NV-Dedup: High-Performance Inline Deduplication for Non-Volatile MemoryIEEE Transactions on Computers, 2017
- TDV Cache: Organizing Off-Chip DRAM Cache of NVMM from a Fusion Perspective2017
- Temporal correlation detection using computational phase-change memoryNature Communications, 2017
- Optimizing Graph Processing on GPUsIEEE Transactions on Parallel and Distributed Systems, 2016
- Writeback throttling in a virtualized system with SCMFrontiers of Computer Science, 2015
- Coral: A Cloud-Backed Frugal File SystemIEEE Transactions on Parallel and Distributed Systems, 2015
- System software for persistent memory2014
- Whole-system persistenceACM SIGARCH Computer Architecture News, 2012
- MnemosyneACM SIGARCH Computer Architecture News, 2011
- Moneta: A High-Performance Storage Array Architecture for Next-Generation, Non-volatile Memories2010