CEFL: Carbon-Efficient Federated Learning
Authors:
Preprint
Abstract
Federated Learning (FL) distributes machine learning (ML) training across many edge devices to reduce data transfer overhead and protect data privacy. Since FL model training may span millions of devices and is thus resource-intensive, prior work has focused on improving its resource efficiency to optimize time-to-accuracy. However, prior work generally treats all resources the same, while, in practice, they may incur widely different costs, which instead motivates optimizing cost-to-accuracy. To address the problem, we design CEFL, which uses adaptive cost-aware client selection policies to optimize an arbitrary cost metric when training FL models. Our policies extend and combine prior work on utility-based client selection and critical learning periods by making them cost-aware. We demonstrate CEFL by designing carbon-efficient FL, where energy's carbon-intensity is the cost, and show that it i) reduces carbon emissions by 93\% and reduces training time by 50% compared to random client selection and ii) reduces carbon emissions by 80%, while only increasing training time by 38%, compared to a state-of-the-art approach that optimizes training time.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- Client Selection in Federated Learning: Principles, Challenges, and OpportunitiesIEEE Internet of Things Journal, 2023
- The Carbon Footprint of Machine Learning Training Will Plateau, Then ShrinkComputer, 2022
- Dynamic defense against byzantine poisoning attacks in federated learningFuture Generation Computer Systems, 2022
- Helios: Heterogeneity-Aware Federated Learning with Dynamically Balanced Collaboration2021
- A Survey of Incentive Mechanism Design for Federated LearningIEEE Transactions on Emerging Topics in Computing, 2021
- FairFL: A Fair Federated Learning Approach to Reducing Demographic Bias in Privacy-Sensitive Classification Models2020
- Federated Learning in Mobile Edge Networks: A Comprehensive SurveyIEEE Communications Surveys & Tutorials, 2020
- Adaptive Federated Learning in Resource Constrained Edge Computing SystemsIEEE Journal on Selected Areas in Communications, 2019
- Machine learning: Trends, perspectives, and prospectsScience, 2015
- Results from deploying a participation incentive mechanism within the enterprise2008