AA-Dedupe: An Application-Aware Source Deduplication Approach for Cloud Backup Services in the Personal Computing Environment
Authors:
- Yinjin FuYFYinjin Fu
- Hong JiangHJHong Jiang
- Nong XiaoNXNong Xiao
- Lei TianLTLei Tian
- Fang LiuFLFang Liu
- 1 September 2011
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15525244,p. 112-120
Abstract
The market for cloud backup services in the personal computing environment is growing due to large volumes of valuable personal and corporate data being stored on desktops, laptops and smart phones. Source deduplication has become a mainstay of cloud backup that saves network bandwidth and reduces storage space. However, there are two challenges facing deduplication for cloud backup service clients: (1) low deduplication efficiency due to a combination of the resource-intensive nature of deduplication and the limited system resources on the PC-based client site, and (2) low data transfer efficiency since post-deduplication data transfers from source to backup servers are typically very small but must often cross a WAN. In this paper, we present AA-Dedupe, an application-aware source deduplication scheme, to significantly reduce the computational overhead, increase the deduplication throughput and improve the data transfer efficiency. The AA-Dedupe approach is motivated by our key observations of the substantial differences among applications in data redundancy and deduplication characteristics, and thus is based on an application-aware index structure that effectively exploits this application awareness. Our experimental evaluations, based on an AA-Dedupe prototype implementation, show that our scheme can improve deduplication efficiency over the state-of-art source-deduplication methods by a factor of 2-7, resulting in shortened backup window, increased power-efficiency and reduced cost for cloud backup services.Keywords
This publication has 8 references indexed in Scilit:
- P3Stor: A parallel, durable flash-based SSD for enterprise-scale storage systemsScience China Information Sciences, 2011
- A first look at traffic on smartphones2010
- SAM: A Semantic-Aware Multi-tiered Source De-duplication Framework for Cloud Backup2010
- CumulusACM Transactions on Storage, 2009
- Extreme Binning: Scalable, parallel deduplication for chunk-based file backup2009
- Multi-level comparison of data deduplication in a backup scenario2009
- ADMAD: Application-Driven Metadata Aware De-duplication Archival Storage System2008
- A five-year study of file-system metadataACM Transactions on Storage, 2007