Enhancing X-ray Image Classification through Heterogeneous Federated Learning with Natural Image-Augmented Models
- 1 January 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 48 (10) , 1-18
Abstract
Deep learning-based computer-aided diagnosis (DL-CAD) models have achieved remarkable success in X-ray image analysis. Yet their effectiveness is often constrained by the tight regulations of governing sensitive X-ray data. Federated Learning (FL) offers a promising paradigm by facilitating the collaborative training of DL-CAD models across healthcare institutions without compromising data privacy. Despite this advancement, the limited local X-ray archives and the issue of heterogeneous model architectures bring distinctive challenges. To address these challenges, this work pioneers the utilization of natural images to develop a natural image-augmented heterogeneous FL framework (NatIMG-FL) for X-ray classification. For augmenting local training, NatIMG-FL leverages natural images as auxiliary supervised data to facilitate the alignment of feature distributions between natural and X-ray images. To tackle the model heterogeneity issue, NatIMG-FL introduces a novel dual weights-based fine-grained knowledge transfer method, enabling adaptive knowledge exchange between local and central models. The NatIMG-FL framework provides insights into exploiting natural images as proxy datasets to enhance knowledge transfer in heterogeneous FL for X-ray classification.Keywords
Funding Information
- National Natural Science Foundation of China (62572413)
- Research Grants Council of the Hong Kong SAR (C5052-23G)
- PolyU (P0060259)
- Guangdong and Hong Kong Universities
- Department of Science and Technology of Guangdong (2025TQ09A636)
This publication has 49 references indexed in Scilit:
- Exploiting features and logits in heterogeneous federated learningComputer Networks, 2025
- ACT: Semi-supervised Domain-Adaptive Medical Image Segmentation with Asymmetric Co-training2022
- Federated Semi-supervised Medical Image Classification via Inter-client Relation Matching2021
- Attract, Perturb, and Explore: Learning a Feature Alignment Network for Semi-supervised Domain Adaptation2020
- Medical image classification using synergic deep learningMedical Image Analysis, 2019
- Pre-training on Grayscale ImageNet Improves Medical Image Classification2019
- Task Driven Generative Modeling for Unsupervised Domain Adaptation: Application to X-ray Image Segmentation2018
- Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep LearningCell, 2018
- Unsupervised Domain Adaptation in Brain Lesion Segmentation with Adversarial Networks2017
- Supervised domain adaptation of decision forests: Transfer of models trained in vitro for in vivo intravascular ultrasound tissue characterizationMedical Image Analysis, 2016