A Cloud-Scale Characterization of Remote Procedure Calls
Authors:
- Korakit SeemakhuptKSKorakit Seemakhupt
- Brent E. StephensBSBrent E. Stephens
- Samira KhanSKSamira Khan
- Sihang LiuSLSihang Liu
- Hassan WasselHWHassan Wassel
- Soheil Hassas YeganehSYSoheil Hassas Yeganeh
- Alex C. SnoerenASAlex C. Snoeren
- Arvind KrishnamurthyAKArvind Krishnamurthy
- David E. CullerDCDavid E. Culler
- Henry M. LevyHLHenry M. Levy
Open Access
- 23 October 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 498-514
Abstract
The global scale and challenging requirements of modern cloud applications have led to the development of complex, widely distributed, service-oriented applications. One enabler of such applications is the remote procedure call (RPC), which provides location-independent communication and hides the myriad of cloud communication complexities and requirements within the RPC stack. Understanding RPCs is thus one key to understanding the behavior of cloud applications. While there have been numerous studies of RPCs in distributed systems, as well as attempts to optimize RPC overheads with both software and hardware, there is still a lack of knowledge about the characteristics of RPCs "in the wild" in the modern cloud environment. To address this gap, we present, to the best of our knowledge, the first large-scale fleet-wide study of RPCs. Our study is conducted at Google, where we measured the infrastructure supporting Google's user-facing, billion-user web services, such as Google Search, Gmail, Maps, and YouTube, and the information and data management systems that support them. To carry out the study, we examined over 10,000 different RPC methods sampled from over one billion traces, along with statistics collected every 30 minutes over a period of nearly two years. Among other things, we consider the volume, throughput and growth rate of RPCs in the datacenter, the latency of RPCs and their components (the "RPC latency tax"), and the structure of RPC call chains. Our analysis shows that the characteristics, scope and complexity of RPCs at hyperscale differ significantly from the assumptions made in prior research. Overall, our work provides new insights into RPC usage and characteristics at the largest scale and motivates further research on optimizing the diverse behavior of this crucial communication mechanism.Keywords
This publication has 31 references indexed in Scilit:
- RDMA over Commodity Ethernet at Scale2016
- Inside the Social Network's (Datacenter) Network2015
- Congestion Control for Large-Scale RDMA Deployments2015
- Profiling a warehouse-scale computer2015
- Mercury: Enabling remote procedure call for high-performance computing2013
- Achieving high utilization with software-driven WAN2013
- The tail at scaleCommunications of the ACM, 2013
- Coflow2012
- The Google file system2003
- Implementing remote procedure callsACM Transactions on Computer Systems, 1984