TDDFS
Authors:
Open Access
- 5 February 2019
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Storage
- Vol. 15 (1) , 1-26
Abstract
With the rapid increase in the amount of data produced and the development of new types of storage devices, storage tiering continues to be a popular way to achieve a good tradeoff between performance and cost-effectiveness. In a basic two-tier storage system, a storage tier with higher performance and typically higher cost (the fast tier) is used to store frequently-accessed (active) data while a large amount of less-active data are stored in the lower-performance and low-cost tier (the slow tier). Data are migrated between these two tiers according to their activity. In this article, we propose a Tier-aware Data Deduplication-based File System, called TDDFS, which can operate efficiently on top of a two-tier storage environment. Specifically, to achieve better performance, nearly all file operations are performed in the fast tier. To achieve higher cost-effectiveness, files are migrated from the fast tier to the slow tier if they are no longer active, and this migration is done with data deduplication. The distinctiveness of our design is that it maintains the non-redundant (unique) chunks produced by data deduplication in both tiers if possible. When a file is reloaded (called a reloaded file) from the slow tier to the fast tier, if some data chunks of the file already exist in the fast tier, then the data migration of these chunks from the slow tier can be avoided. Our evaluation shows that TDDFS achieves close to the best overall performance among various file-tiering designs for two-tier storage systems.Keywords
Funding Information
- National Science Foundation (1421913, 1439622, 1525617, 181253)
This publication has 10 references indexed in Scilit:
- The First Collision for Full SHA-12017
- A Comprehensive Study of the Past, Present, and Future of Data DeduplicationProceedings of the IEEE, 2016
- A survey and comparative study of data deduplication techniques2015
- A Survey and Classification of Storage Deduplication SystemsACM Computing Surveys, 2014
- Big Data: A SurveyMobile Networks and Applications, 2014
- A study of practical deduplicationACM Transactions on Storage, 2012
- AA-Dedupe: An Application-Aware Source Deduplication Approach for Cloud Backup Services in the Personal Computing Environment2011
- DBLK: Deduplication for primary block storage2011
- Efficient Deduplication Techniques for Modern Backup OperationIEEE Transactions on Computers, 2010
- The Hadoop Distributed File System2010