Generalized Rack-aware Regenerating Codes for Jointly Optimal Node and Rack Repairs
Authors:
- 12 July 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2191-2196
Abstract
In data centers, storage nodes are organized in racks and the cross-rack communication bandwidth is often much lower than the intra-rack communication bandwidth. Two common failures in data centers are single-node failures and single-rack failures. In this paper, we study the problem of minimizing the cross-rack repair bandwidth in both repairing single-node failures and repairing single-rack failures. We characterize, given that the minimum cross-rack repair bandwidth for single-node failures is achieved, the optimal trade-off between storage and cross-rack repair bandwidth for single-rack failures. We further propose a general family of storage codes, Generalized Rack-aware Regenerating Codes (GRRC), that achieve the optimal trade-off. We obtain two extreme points of GRRC, namely the minimum storage generalized rack-aware regeneration (MSGRR) point and the minimum bandwidth generalized rack-aware regeneration (MB-GRR) point. We show that MSGRR codes have strictly less cross-rack repair bandwidth for single-rack failures than the related minimum storage multi-node repair codes for most parameters. We also show that MBGRR codes have less cross-rack repair bandwidth for single-rack failures than the minimum bandwidth multi-node repair codes for all our evaluated parameters.Keywords
Funding Information
- National Key R&D Program of China (2020YFA0712300)
- National Natural Science Foundation of China (62071121)
- Innovation and Technology Fund (ITS/315/18FX)
This publication has 25 references indexed in Scilit:
- Minimum Storage Rack-Aware Regenerating Codes with Exact Repair and Small Sub-Packetization2020
- Storage and repair bandwidth tradeoff for heterogeneous cluster distributed storage systemsScience China Information Sciences, 2020
- Double Regenerating Codes for hierarchical data centers2016
- Characterizing the Rate Region of the (4,3,3) Exact-Repair Regenerating CodesIEEE Journal on Selected Areas in Communications, 2014
- Non-homogeneous two-rack model for distributed storage systems2013
- Asymptotic Interference Alignment for Optimal Repair of MDS Codes in Distributed StorageIEEE Transactions on Information Theory, 2013
- Zigzag Codes: MDS Array Codes With Optimal RebuildingIEEE Transactions on Information Theory, 2012
- Interference Alignment in Regenerating Codes for Distributed Storage: Necessity and Code ConstructionsIEEE Transactions on Information Theory, 2011
- Optimal Exact-Regenerating Codes for Distributed Storage at the MSR and MBR Points via a Product-Matrix ConstructionIEEE Transactions on Information Theory, 2011
- Network Coding for Distributed Storage SystemsIEEE Transactions on Information Theory, 2010