Real world federated learning with a knowledge distilled transformer for cardiac CT imaging
Top Cited Papers
Open Access
- 6 February 2025
- journal article
- research article
- Published by Springer Nature in npj Digital Medicine
- Vol. 8 (1) , 1-14
Abstract
Federated learning is a renowned technique for utilizing decentralized data while preserving privacy. However, real-world applications often face challenges like partially labeled datasets, where only a few locations have certain expert annotations, leaving large portions of unlabeled data unused. Leveraging these could enhance transformer architectures’ ability in regimes with small and diversely annotated sets. We conduct the largest federated cardiac CT analysis to date (n = 8, 104) in a real-world setting across eight hospitals. Our two-step semi-supervised strategy distills knowledge from task-specific CNNs into a transformer. First, CNNs predict on unlabeled data per label type and then the transformer learns from these predictions with label-specific heads. This improves predictive accuracy and enables simultaneous learning of all partial labels across the federation, and outperforms UNet-based models in generalizability on downstream tasks. Code and model weights are made openly available for leveraging future cardiac CT analysis.Keywords
All Related Versions
This publication has 69 references indexed in Scilit:
- FUNAvg: Federated Uncertainty Weighted Averaging for Datasets with Diverse Labels2024
- Bildverarbeitung für die Medizin 20242024
- ConDistFL: Conditional Distillation for Federated Learning from Partially Annotated Data2023
- MultiTalent: A Multi-dataset Approach to Medical Image Segmentation2023
- Content-Aware Differential Privacy with Conditional Invertible Neural Networks2022
- Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Images2022
- Segmentations-Leak: Membership Inference Attacks and Defenses in Semantic Image Segmentation2020
- Fed-BioMed: A General Open-Source Frontend Framework for Federated Learning in Healthcare2020
- Generalised Dice Overlap as a Deep Learning Loss Function for Highly Unbalanced Segmentations2017
- 3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation2016