FedMSA: A Model Selection and Adaptation System for Federated Learning
Open Access
Abstract
Federated Learning (FL) enables multiple clients to train a shared model collaboratively without sharing any personal data. However, selecting a model and adapting it quickly to meet user expectations in a large-scale FL application with heterogeneous devices is challenging. In this paper, we propose a model selection and adaptation system for Federated Learning (FedMSA), which includes a hardware-aware model selection algorithm that trades-off model training efficiency and model performance base on FL developers’ expectation. Meanwhile, considering the expected model should be achieved by dynamic model adaptation, FedMSA supports full automation in building and deployment of the FL task to different hardware at scale. Experiments on benchmark and real-world datasets demonstrate the effectiveness of the model selection algorithm of FedMSA in real devices (e.g., Raspberry Pi and Jetson nano).Keywords
Funding Information
- EPSRC (EP/T021985/1, EP/W003325/1, EP/V042017/1)
This publication has 25 references indexed in Scilit:
- Source Model Selection for Deep Learning in the Time Series DomainIEEE Access, 2020
- Machine learning in materials scienceInfoMat, 2019
- FFD: A Federated Learning Based Method for Credit Card Fraud Detection2019
- Progressive Neural Architecture Search2018
- Adaptive deep learning model selection on embedded systemsACM SIGPLAN Notices, 2018
- ImageNet classification with deep convolutional neural networksCommunications of the ACM, 2017
- Edge Computing: Vision and ChallengesIEEE Internet of Things Journal, 2016
- Deep Residual Learning for Image Recognition2016
- Machine learning: Trends, perspectives, and prospectsScience, 2015
- A view of cloud computingCommunications of the ACM, 2010