When the network crumbles
Authors:
Open Access
- 1 October 2013
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-17
Abstract
The growing demand for always-on and low-latency cloud services is driving the creation of globally distributed datacenters. A major factor affecting service availability is reliability of the network, both inside the datacenters and wide-area links connecting them. While several research efforts focus on building scale-out datacenter networks, little has been reported on real network failures and how they impact geo-distributed services. This paper makes one of the first attempts to characterize intra-datacenter and inter-datacenter network failures from a service perspective. We describe a large-scale study analyzing and correlating failure events over three years across multiple datacenters and thousands of network elements such as Access routers, Aggregation switches, Top-of-Rack switches, and long-haul links. Our study reveals several important findings on (a) the availability of network domains, (b) root causes, (c) service impact, (d) effectiveness of repairs, and (e) modeling failures. Finally, we outline steps based on existing network mechanisms to improve service availability.Keywords
This publication has 29 references indexed in Scilit:
- California fault linesACM SIGCOMM Computer Communication Review, 2010
- VL2ACM SIGCOMM Computer Communication Review, 2009
- Detailed diagnosis in enterprise networksACM SIGCOMM Computer Communication Review, 2009
- PortLandACM SIGCOMM Computer Communication Review, 2009
- An analysis of data corruption in the storage stackACM Transactions on Storage, 2008
- Are disks the dominant contributor for storage failures?ACM Transactions on Storage, 2008
- Lessons from giant-scale servicesIEEE Internet Computing, 2001
- Lightpath restoration in WDM optical networksIEEE Network, 2000
- The expectation-maximization algorithmIEEE Signal Processing Magazine, 1996
- On the Kolmogorov-Smirnov Test for the Exponential Distribution with Mean UnknownJournal of the American Statistical Association, 1969