TOFEC: Achieving optimal throughput-delay trade-off of cloud storage using erasure codes
Authors:
- 1 April 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 0743166X,p. 826-834
Abstract
Our paper presents solutions using erasure coding, parallel connections to storage cloud and limited chunking (i.e., dividing the object into a few smaller segments) together to significantly improve the delay performance of uploading and downloading data in and out of cloud storage. TOFEC is a strategy that helps front-end proxy adapt to level of workload by treating scalable cloud storage (e.g. Amazon S3) as a shared resource requiring admission control. Under light workloads, TOFEC creates more smaller chunks and uses more parallel connections per file, minimizing service delay. Under heavy workloads, TOFEC automatically reduces the level of chunking (fewer chunks with increased size) and uses fewer parallel connections to reduce overhead, resulting in higher throughput and preventing queueing delay. Our trace-driven simulation results show that TOFEC's adaptation mechanism converges to an appropriate code that provides the optimal delay-throughput trade-off without reducing system capacity. Compared to a non-adaptive strategy optimized for throughput, TOFEC delivers 2.5× lower latency under light workloads; compared to a non-adaptive strategy optimized for latency, TOFEC can scale to support over 3× as many requests.Keywords
All Related Versions
This publication has 11 references indexed in Scilit:
- FAST CLOUD: Pushing the Envelope on Delay Performance of Cloud Storage With CodingIEEE/ACM Transactions on Networking, 2013
- Codes can reduce queueing delay in data centers2012
- Evaluating Forward Error Correction performance in BitTorrent protocol2010
- Network Coding for Distributed Storage SystemsIEEE Transactions on Information Theory, 2010
- Tree-structured Data Regeneration in Distributed Storage Systems with Regenerating Codes2010
- On the delay of network coding over line networks2009
- Minimizing Delay for Multicast-Streaming in Wireless Networks with Network Coding2009
- On the Delay and Throughput Gains of Coding in Unreliable NetworksIEEE Transactions on Information Theory, 2008
- On the Throughput Capacity of Opportunistic Multicasting with Erasure Codes2008
- MPLOT: A Transport Protocol Exploiting Multipath Diversity Using Erasure Codes2008