FaaSKeeper: Learning from Building Serverless Services with ZooKeeper as an Example
Authors:
Preprint
Abstract
FaaS (Function-as-a-Service) revolutionized cloud computing by replacing persistent virtual machines with dynamically allocated resources. This shift trades locality and statefulness for a pay-as-you-go model more suited to variable and infrequent workloads. However, the main challenge is to adapt services to the serverless paradigm while meeting functional, performance, and consistency requirements. In this work, we push the boundaries of FaaS computing by designing a serverless variant of ZooKeeper, a centralized coordination service with a safe and wait-free consensus mechanism. We define synchronization primitives to extend the capabilities of scalable cloud storage and outline a set of requirements for efficient computing with serverless. In FaaSKeeper, the first coordination service built on serverless functions and cloud-native services, we explore the limitations of serverless offerings and propose improvements essential for complex and latency-sensitive applications. We share serverless design lessons based on our experiences of implementing a ZooKeeper model deployable to clouds today. FaaSKeeper maintains the same consistency guarantees and interface as ZooKeeper, with a serverless price model that lowers costs up to 110-719x on infrequent workloads.Keywords
All Related Versions
This publication has 44 references indexed in Scilit:
- rFaaS: Enabling High Performance Serverless with RDMA and Leases2023
- Agora: A Dependable High-Performance Coordination Service for Multi-cores2017
- GIRAFFE: A scalable distributed coordination service for large-scale systems2014
- Winds of Change: From Vendor Lock-In to the Meta CloudIEEE Internet Computing, 2013
- Data Centers in the Cloud: A Large Scale Performance Study2012
- Zab: High-performance broadcast for primary-backup systems2011
- Portability and Interoperability between Clouds: Challenges and Case Study2011
- Workload Analysis and Demand Prediction of Enterprise Data Center Applications2007
- Object Storage: The Future Building Block for Storage Systems A Position Paper2006
- Towards an object store2003