Pyramid Codes
Authors:
Open Access
- 1 March 2013
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Storage
- Vol. 9 (1) , 1-28
Abstract
We design flexible schemes to explore the tradeoffs between storage space and access efficiency in reliable data storage systems. Aiming at this goal, two new classes of erasure-resilient codes are introduced -- Basic Pyramid Codes (BPC) and Generalized Pyramid Codes (GPC). Both schemes require slightly more storage space than conventional schemes, but significantly improve the critical performance of read during failures and unavailability. As a by-product, we establish a necessary matching condition to characterize the limit of failure recovery, that is, unless the matching condition is satisfied, a failure case is impossible to recover. In addition, we define a maximally recoverable (MR) property. For all ERC schemes holding the MR property, the matching condition becomes sufficient, that is, all failure cases satisfying the matching condition are indeed recoverable. We show that GPC is the first class of non-MDS schemes holding the MR property.Keywords
Funding Information
- Research Grants Council, University Grants Committee, Hong Kong (411209, 411010, 411011)
- Area of Excellence Grant (AoE/E-02/08)
- Cisco Systems
- Ministry of Science and Technology of the People's Republic of China (2012CB315904)
- Microsoft
- Open Project of Shenzhen Key Lab of Cloud Computing Technology and Application
This publication has 22 references indexed in Scilit:
- Windows Azure Storage2011
- Using Erasure Codes Efficiently for Storage in a Distributed System2005
- The Google file system2003
- Efficient erasure correcting codesIEEE Transactions on Information Theory, 2001
- A prototype implementation of archival Intermemory1999
- On lowest density MDS codesIEEE Transactions on Information Theory, 1999
- EVENODD: an efficient scheme for tolerating double disk failures in RAID architecturesIEEE Transactions on Computers, 1995
- RAID: high-performance, reliable secondary storageACM Computing Surveys, 1994
- A recursive approach to low complexity codesIEEE Transactions on Information Theory, 1981
- Polynomial Codes Over Certain Finite FieldsJournal of the Society for Industrial and Applied Mathematics, 1960