Federated Learning Across Decentralized and Unshared Archives for Remote Sensing Image Classification: A review
- 12 July 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Magazine
- Vol. 12 (3) , 64-80
Abstract
Federated learning (FL) enables the collaboration of multiple deep learning (DL) models to learn from decentralized data archives (i.e., clients) without accessing data on the clients. Although FL offers ample opportunities in knowledge discovery from distributed image archives, it is seldom considered in remote sensing (RS). In this article, for the first time in RS, we present a comparative study of state-of-the-art FL algorithms for RS image classification problems. To this end, we initially provide a systematic review of the FL algorithms presented in the computer vision (CV) and machine learning (ML) communities. Then, we select several state-of-the-art FL algorithms based on their effectiveness with respect to training data heterogeneity across clients [known as not independent and identically distributed (non-IID) data]. After presenting an extensive overview of the selected algorithms, we conduct a theoretical comparison of them based on their 1) local training complexity, 2) aggregation complexity, 3) learning efficiency, 4) communication cost, and 5) scalability in terms of number of clients. After the theoretical comparison, experimental analyses are presented to compare the algorithms under different decentralization scenarios. For the experimental analyses, we focus our attention on multilabel image classification (MLC) problems in RS. Based on our comprehensive analyses, we finally derive a guideline for selecting suitable FL algorithms in RS. The code of this work is publicly available at https://git.tu-berlin.de/rsim/FL-RS .Keywords
All Related Versions
Funding Information
- European Research Council (759764)
This publication has 33 references indexed in Scilit:
- Learning Across Decentralized Multi-Modal Remote Sensing Archives with Federated Learning2023
- Model compression and privacy preserving framework for federated learningFuture Generation Computer Systems, 2022
- Prototype-Based Clustered Federated Learning for Semantic Segmentation of Aerial Images2022
- Local Learning Matters: Rethinking Data Heterogeneity in Federated Learning2022
- FedDC: Federated Learning with Non-IID Data via Local Drift Decoupling and Correction2022
- Layer-wised Model Aggregation for Personalized Federated Learning2022
- Model-Contrastive Federated Learning2021
- Cost-Effective Federated Learning Design2021
- Internet of Things (IoT): A review of enabling technologies, challenges, and open research issuesComputer Networks, 2018
- Deep Residual Learning for Image Recognition2016