Trade Privacy for Utility: A Learning-Based Privacy Pricing Game in Federated Learning
Authors:
Preprint
Abstract
To prevent implicit privacy disclosure in sharing gradients among data owners (DOs) under federated learning (FL), differential privacy (DP) and its variants have become a common practice to offer formal privacy guarantees with low overheads. However, individual DOs generally tend to inject larger DP noises for stronger privacy provisions (which entails severe degradation of model utility), while the curator (i.e., aggregation server) aims to minimize the overall effect of added random noises for satisfactory model performance. To address this conflicting goal, we propose a novel dynamic privacy pricing (DyPP) game which allows DOs to sell individual privacy (by lowering the scale of locally added DP noise) for differentiated economic compensations (offered by the curator), thereby enhancing FL model utility. Considering multi-dimensional information asymmetry among players (e.g., DO's data distribution and privacy preference, and curator's maximum affordable payment) as well as their varying private information in distinct FL tasks, it is hard to directly attain the Nash equilibrium of the mixed-strategy DyPP game. Alternatively, we devise a fast reinforcement learning algorithm with two layers to quickly learn the optimal mixed noise-saving strategy of DOs and the optimal mixed pricing strategy of the curator without prior knowledge of players' private information. Experiments on real datasets validate the feasibility and effectiveness of the proposed scheme in terms of faster convergence speed and enhanced FL model utility with lower payment costs.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- A Platform-Free Proof of Federated Learning Consensus Mechanism for Sustainable BlockchainsIEEE Journal on Selected Areas in Communications, 2022
- A Stackelberg Incentive Mechanism for Wireless Federated Learning With Differential PrivacyIEEE Wireless Communications Letters, 2022
- A Differentially Private Federated Learning Model against Poisoning Attacks in Edge ComputingIEEE Transactions on Dependable and Secure Computing, 2022
- Loss-Privacy Tradeoff in Federated Edge LearningIEEE Journal of Selected Topics in Signal Processing, 2022
- Dynamic Federated Learning-Based Economic Framework for Internet-of-VehiclesIEEE Transactions on Mobile Computing, 2021
- Cost-Effective Federated Learning in Mobile Edge NetworksIEEE Journal on Selected Areas in Communications, 2021
- Pain-FL: Personalized Privacy-Preserving Incentive for Federated LearningIEEE Journal on Selected Areas in Communications, 2021
- Optimal Contract Design for Efficient Federated Learning With Multi-Dimensional Private InformationIEEE Journal on Selected Areas in Communications, 2020
- Hierarchical Incentive Mechanism Design for Federated Machine Learning in Mobile NetworksIEEE Internet of Things Journal, 2020
- Privacy or Utility in Data Collection? A Contract Theoretic ApproachIEEE Journal of Selected Topics in Signal Processing, 2015