Evolving the Cloud Block Store with Performance, Elasticity, Availability, and Hardware Offloading
Open Access
- 8 February 2025
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Storage
- Vol. 21 (2) , 1-29
Abstract
In this paper, we qualitatively and quantitatively discuss the design choices, production experience, and lessons in building the Elastic Block Storage ( EBS ) at Alibaba Cloud over the past decade. To cope with hardware advancement and users’ demands, we shift our focus from design simplicity in EBS1 to high performance and space efficiency in EBS2 , and finally reducing network traffic amplification in EBS3 . In addition to the architectural evolutions, we also summarize development lessons and experiences as four topics, including: (i) achieving high elasticity in latency, throughput, IOPS, and capacity; (ii) improving availability by minimizing the blast radius of individual, regional, and global failure events; (iii) identifying the motivations and key tradeoffs in various hardware offloading solutions; and (iv) identifying the pros/cons of alternative solutions and explaining why seemingly promising ideas would not work in practice.Keywords
This publication has 11 references indexed in Scilit:
- From luna to solar2022
- Beating the I/O bottleneck2022
- Using Lightweight Formal Methods to Validate a Key-Value Storage Node in Amazon S32021
- Octopus + : An RDMA-Enabled Distributed Persistent Memory File SystemACM Transactions on Storage, 2021
- Kunpeng 920: The First 7-nm Chiplet-Based 64-Core ARM SoC for Cloud ServicesIEEE Micro, 2021
- High-density Multi-tenant Bare-metal Cloud2020
- FIDR2019
- URSA2019
- Windows Azure Storage2011
- The design and implementation of a log-structured file system1991