Federated Ensembles: a literature review
Preprint
- 9 December 2022
- preprint
- Published by Springer Nature in Research Square
Abstract
Federated learning (FL) allows machine learning algorithms to be applied to decentralized data when data sharing is not an option due to privacy concerns. Ensemble-based learning works by training multiple (weak) classifiers whose output is aggregated. Federated ensembles are ensembles applied to a federated setting, where each classifier in the ensemble is trained on one data location. The aim of this review is to provide an overview of the published literature on federated ensembles, their applications, the methods used, the challenges faced, the proposed solutions and their comparative performance. We searched for publications on federated ensembles on five databases (ACM Digital Library, IEEE, arXiv, Google scholar and Scopus) published after 2016. We found 26 articles describing studies either proposing federated ensemble applications or comparing federated ensembles to other federated learning approaches. Federated ensembles were used for a wide varied applications beyond classification. Advocates of federated ensemble mentioned their ability to handle local biases in data. In comparison to federated learning approaches, federated ensembles underperformed in small sample sizes and highly class imbalanced settings. Only 10 articles discussed privacy guarantees or additional privacy preserving techniques. Federated ensembles represent an interesting alternative to federated averaging algorithms that is inherently privacy preserving. They have proved their versatility but remain underutilized.Keywords
All Related Versions
This publication has 35 references indexed in Scilit:
- Edge-centric inferential modeling & analyticsJournal of Network and Computer Applications, 2020
- Multi-site fMRI analysis using privacy-preserving federated learning and domain adaptation: ABIDE resultsMedical Image Analysis, 2020
- Privacy-Preserving Traffic Flow Prediction: A Federated Learning ApproachIEEE Internet of Things Journal, 2020
- Policy based Ensembles for applying ML on Big Data2019
- An Ensemble Approach to Time Dependent Classification2018
- Enhancing accuracy and interpretability of ensemble strategies in credit risk assessment. A correlated-adjusted decision forest proposalExpert Systems with Applications, 2015
- A review of feature selection methods with applications2015
- The Algorithmic Foundations of Differential PrivacyFoundations and Trends® in Theoretical Computer Science, 2014
- Survey of Various Homomorphic Encryption algorithms and SchemesInternational Journal of Computer Applications, 2014
- Protocols for secure computations1982