Leveraging Service Meshes as a New Network Layer
Authors:
Open Access
- 4 November 2021
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 229-236
Abstract
As modern cloud services have scaled out, applications have moved from relatively monolithic designs to highly modularized fleets of microservices that communicate among each other to perform application-level tasks. These microservices effectively form a network at the application layer, and service mesh frameworks have recently emerged to factor out microservices' common communication functionality. This paper seeks to highlight the emergence of service meshes as what is effectively a new layer in the networking stack, and the associated new challenges and opportunities. As a case study, we leverage the fact that service meshes can be better informed about application needs, and design a system that utilizes provenance tracing within the service mesh to perform cross-layer prioritization of latency-sensitive requests, within an application serving a mix of workloads. Broadly speaking, we believe that as applications factor out communication into service meshes, an exciting new domain is opening that can utilize techniques from the networking community to improve application performance.Keywords
Funding Information
- AG NIFA (2021-67021-34418)
- Intel Corporation
This publication has 18 references indexed in Scilit:
- The QUIC Transport Protocol2017
- Efficient Redundancy Techniques for Latency Reduction in Cloud SystemsACM Transactions on Modeling and Performance Evaluation of Computing Systems, 2017
- Efficient coflow scheduling with Varys2014
- B4ACM SIGCOMM Computer Communication Review, 2013
- Achieving high utilization with software-driven WAN2013
- Low Extra Delay Background Transport (LEDBAT)2012
- Rethinking end-to-end congestion control in software-defined networks2012
- Coflow2012
- Better never than late2011
- TCP-LP: low-priority service via end-point congestion controlIEEE/ACM Transactions on Networking, 2006