Hyper-parameter Tuning of Federated Learning Based on Particle Swarm Optimization
Authors:
- 7 November 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 99-103
Abstract
The learning task of federated learning (FL) is solved by a federation of a center server and individual clients. Contrary to traditional deep learning models, federated learning consists of two parts, the global model and individual models. However, since the process is carried out by two parts of equal importance, it is ideal to deal with both parts simultaneously. To achieve superior performance, federated learning requires carefully selected hyper-parameters, which has more hyper-parameters than those of traditional deep learning models. To solve this tuning problem, we propose a method using particle swarm optimization (PSO) algorithm to tune the hyperparameters of federated learning. PSO algorithm is a gradient-free, stochastic optimization method which is better than grid search method when it comes to large search space. It helps locate the optimal combination of multiple parameters. In this article, we focus on applying PSO method on tuning the hyper-parameters of FL models, and prove that it is an efficient way to acquire satisfactory results. Experiments on MNIST dataset with convolution neural networks have proved the superiority of the proposed method.Keywords
Funding Information
- Research and Development
- National Natural Science Foundation of China
- Fundamental Research Funds for the Central Universities
This publication has 3 references indexed in Scilit:
- Particle Swarm Optimized Federated Learning For Industrial IoT and Smart City Services2020
- LoAdaBoost: Loss-based AdaBoost federated machine learning with reduced computational complexity on IID and non-IID intensive care dataPLOS ONE, 2020
- A novel intelligent fault diagnosis method of rotating machinery based on deep learning and PSO-SVMJournal of Vibroengineering, 2017