Adrien Gallego
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Adrien Gallego has a total of 4 co-authors. Here are the top co-authors by number of shared publications:
- Uraz Odyurt
University of Twente
1 shared publication - Yi Cheng
Informatics Institute, University of Amsterdam, Amsterdam, The Netherlands
1 shared publication - Yuandou Wang
University of Amsterdam
1 shared publication - Zhiming Zhao
Research Group of Multi-Scale Networked Systems, University of Amsterdam, Amsterdam, The Netherlands
1 shared publication
Latest Publications
- Open Access
- 4 December 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Machine Learning Inference on Serverless Platforms Using Model Decomposition
Serverless offers a scalable and cost-effective service model for users to run applications without focusing on underlying infrastructure or physical servers. While the Serverless architecture is not designed to address the unique challenges posed by resource-intensive workloads, e.g., Machine Learning (ML) tasks, it is highly scalable. Due to the limitations of Serverless function deployment and resource provisioning, the combination of ML and Serverless is a complex undertaking. We tackle this problem through decomposition of large ML models into smaller sub-models, referred to as slices. We set up ML inference tasks using these slices as a Serverless workflow, i.e., sequence of functions. Our experimental evaluations are performed on the Serverless offering by AWS for demonstration purposes, considering an open-source format for ML model representation, Open Neural Network Exchange. Achieved results portray that our decomposition method enables the execution of ML inference tasks on Serverless, regardless of the model size, benefiting from the high scalability of this architecture while lowering the strain on computing resources, such as required run-time memory.
- 4 December 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Open AccessMachine Learning Inference on Serverless Platforms Using Model Decomposition
Serverless offers a scalable and cost-effective service model for users to run applications without focusing on underlying infrastructure or physical servers. While the Serverless architecture is not designed to address the unique challenges posed by resource-intensive workloads, e.g., Machine Learning (ML) tasks, it is highly scalable. Due to the limitations of Serverless function deployment and resource provisioning, the combination of ML and Serverless is a complex undertaking. We tackle this problem through decomposition of large ML models into smaller sub-models, referred to as slices. We set up ML inference tasks using these slices as a Serverless workflow, i.e., sequence of functions. Our experimental evaluations are performed on the Serverless offering by AWS for demonstration purposes, considering an open-source format for ML model representation, Open Neural Network Exchange. Achieved results portray that our decomposition method enables the execution of ML inference tasks on Serverless, regardless of the model size, benefiting from the high scalability of this architecture while lowering the strain on computing resources, such as required run-time memory.