Reducing bias and increasing utility by federated generative modeling of medical images using a centralized adversary
Authors:
Open Access
- 9 September 2021
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 79-84
Abstract
A major roadblock in machine learning for healthcare is the inability of data to be shared broadly, due to privacy concerns. Privacy preserving synthetic data generation is increasingly being seen as a solution to this problem. However, since healthcare data often has significant site-specific biases, it has motivated the use of federated learning when the goal is to utilize data from multiple sites for machine learning model training. Here, we introduce FELICIA (FEderated LearnIng with a CentralIzed Adversary), a generative mechanism enabling collaborative learning. It is a generalized extension of the (local) PrivGAN mechanism allowing to take into account the diversity (non-IID) nature of the federated sites. In particular, we show how a site with limited and biased data could benefit from other sites while keeping data from all the sources private. FELICIA works for a large family of Generative Adversarial Networks (GAN) architectures including vanilla and conditional GANs as demonstrated in this work. We show that by using the FELICIA mechanism, a site with a limited amount of images can generate high-quality synthetic images with improved utility, while none of the sites need to provide access to their real data. The sharing happens solely through a central discriminator with access limited to synthetic data. We demonstrate these benefits on several realistic healthcare scenarios using benchmark image datasets (MNIST, CIFAR-10) as well as on medical images for the task of skin lesion classification. We show that the utility of synthetic images generated by FELICIA surpasses that of the data available locally and we demonstrate that it can correct the reduced utility of a biased subgroup within a class.Keywords
All Related Versions
This publication has 10 references indexed in Scilit:
- privGAN: Protecting GANs from membership inference attacks at low cost to utilityProceedings on Privacy Enhancing Technologies, 2021
- Detect and correct bias in multi-site neuroimaging datasetsMedical Image Analysis, 2021
- Federated Generative Adversarial Learning2020
- Private data sharing between decentralized users through the privGAN architecture2020
- The future of digital health with federated learningnpj Digital Medicine, 2020
- Synthesis of diagnostic quality cancer pathology images by generative adversarial networksThe Journal of Pathology, 2020
- Private selection from private candidates2019
- MD-GAN: Multi-Discriminator Generative Adversarial Networks for Distributed Datasets2019
- Deep Learning with Differential Privacy2016
- Differential Privacy for Classifier Evaluation2015