EDAS: Enabling Fast Data Loading for GPU Serverless Computing
Open Access
- 17 June 2025
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Architecture and Code Optimization
Abstract
Integrating GPUs into serverless computing platforms is crucial for improving efficiency. Many GPU functions, such as DNN inferences and scientific services, benefit from GPU usage, which requires only tens to hundreds of milliseconds for pure computation. Under these circumstances, fast data loading is imperative for function performance. However, existing GPU serverless systems face significant data stall issues, leading to extremely low GPU efficiency. Faced with the above problems, we observe opportunities to optimize data loading, such as data preloading and deduplicated data loading. However, these optimizations are impossible in existing GPU serverless systems due to the lack of insights into data information, such as data sizes and read-write attributes of function inputs. To address this, we propose a novel GPU serverless system, EDAS. EDAS first enhances user request specifications, allowing users to annotate data retrieved by GPU functions from the database with additional attributes. Based on this, EDAS takes over data loading from GPU functions and proposes two innovative data loading management schemes: a parallelized data loading scheme and a multi-stage resource exit scheme. Our experimental results show that EDAS reduces function duration by 16.2 × and improves system throughput by 1.91 × compared to the state-of-the-art serverless platform.Keywords
This publication has 14 references indexed in Scilit:
- Accelerated serverless computing based on GPU virtualizationJournal of Parallel and Distributed Computing, 2020
- Catalyzer2020
- Replayable Execution Optimized for Page Sharing for a Managed Runtime Environment2019
- Learning Transferable Architectures for Scalable Image Recognition2018
- The SPEC cloud group's research vision on FaaS and serverless architectures2017
- Deep Residual Learning for Image Recognition2016
- Going deeper with convolutions2015
- HalideACM SIGPLAN Notices, 2013
- vCUDA: GPU-Accelerated High-Performance Computing in Virtual MachinesIEEE Transactions on Computers, 2011
- Scalability, fidelity, and containment in the potemkin virtual honeyfarm2005