A Federated Incremental Learning Algorithm Based on Dual Attention Mechanism
Open Access
- 6 October 2022
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 12 (19) , 10025
Abstract
Federated incremental learning best suits the changing needs of common Federal Learning (FL) tasks. In this area, the large sample client dramatically influences the final model training results, and the unbalanced features of the client are challenging to capture. In this paper, a federated incremental learning framework is designed; firstly, part of the data is preprocessed to obtain the initial global model. Secondly, to help the global model to get the importance of the features of the whole sample of each client, and enhance the performance of the global model to capture the critical information of the feature, channel attention neural network model is designed on the client side, and a federated aggregation algorithm based on the feature attention mechanism is designed on the server side. Experiments on standard datasets CIFAR10 and CIFAR100 show that the proposed algorithm accuracy has good performance on the premise of realizing incremental learning.Keywords
Funding Information
- National Natural Science Foundation of China (42075130)
This publication has 33 references indexed in Scilit:
- Multi-Stage Feature Constraints Learning for Age EstimationIEEE Transactions on Information Forensics and Security, 2020
- Parallel Restarted SGD with Faster Convergence and Less Communication: Demystifying Why Model Averaging Works for Deep LearningProceedings of the AAAI Conference on Artificial Intelligence, 2019
- Federated Machine LearningACM Transactions on Intelligent Systems and Technology, 2019
- EGBMMDA: Extreme Gradient Boosting Machine for MiRNA-Disease Association predictionCell Death & Disease, 2018
- Learning without ForgettingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Incremental Learning of Object Detectors without Catastrophic Forgetting2017
- iCaRL: Incremental Classifier and Representation Learning2017
- Deep learning in neural networks: An overviewNeural Networks, 2015
- Speech recognition with deep recurrent neural networks2013
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998