A Transformer-Based Method for Few-Shot Image Recognition in Federated Learning Environments
- 23 July 2025
- journal article
- Published by World Scientific Pub Co Pte Ltd in International Journal of Pattern Recognition and Artificial Intelligence
Abstract
Few-shot image recognition in federated learning (FL) environments presents unique challenges due to data heterogeneity, limited local samples, and strict privacy constraints. To address these issues, we propose a novel Transformer-based approach that enables effective visual recognition with minimal labeled data on distributed clients. The proposed model introduces an adaptive multi-scale window attention mechanism to enhance feature extraction under sparse data conditions. Furthermore, a collaborative attention strategy is developed to enable privacy-preserving semantic knowledge exchange across clients. To alleviate the class imbalance and overfitting problems common in few-shot settings, we design an improved Focal Loss function guided by class-wise entropy. Additionally, a progressive knowledge distillation framework is incorporated to maintain model consistency across training rounds. Extensive experiments conducted on multiple few-shot image benchmarks under federated settings demonstrate that our method significantly outperforms existing baselines in terms of accuracy, communication efficiency, and generalization.Keywords
This publication has 24 references indexed in Scilit:
- FedDiT: Federated Learning by Distillation Token Enhanced Vision Transformer2025
- Personalized federated learning strategies2025
- Improving Small Object Detection with Area-Scaled and Dynamic Focal Loss2025
- TransUNet: Rethinking the U-Net architecture design for medical image segmentation through the lens of transformersMedical Image Analysis, 2024
- SwinSight: a hierarchical vision transformer using shifted windows to leverage aerial image classificationMultimedia Tools and Applications, 2024
- Mutual Correlation Network for few-shot learningNeural Networks, 2024
- Efficient Federated Meta‐Learning Over Multi‐Access Wireless Networks2024
- Task Agnostic Meta-Learning for Few-Shot Learning2019
- Meta-Learning With Differentiable Convex Optimization2019
- Learning to Compare: Relation Network for Few-Shot Learning2018