BTG-Net++: Enhanced Bi-Directional Task-Guided Network for Few-Shot Fine-Grained Image Classification
- 11 June 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 35 (11) , 11462-11473
Abstract
In recent years, a number of effective Few-Shot Fine-Grained Image Classification (FS-FGIC) methods have been proposed, which mainly focus on extracting discriminative information within high-level features in a single episode/task. However, this is insufficient for addressing the cross-task challenges of FS-FGIC, which is represented in two aspects. On the one hand, from the perspective of the Fine-Grained Image Classification (FGIC) task, there is a need to supplement the model with mid-level features containing rich fine-grained information. On the other hand, from the perspective of the Few-Shot Learning (FSL) task, explicit modeling of cross-task general knowledge is required. In this paper, we propose a novel Enhanced Bi-directional Task-Guided Network (BTG-Net++) to tackle these issues. Specifically, from the FGIC task perspective, we design the Semantic-Guided Noise Filtering (SGNF) module to filter noise on mid-level features rich in detailed information with the assistance of high-level features. Further, from the FSL task perspective, the General Knowledge Prompt Modeling (GKPM) module is proposed to retain the cross-task general knowledge by utilizing the prompting mechanism, thereby enhancing the model’s generalization performance on unseen novel classes. We have conducted extensive experiments on five fine-grained benchmark datasets, and the results demonstrate that BTG-Net++ shows considerable improvements compared with state-of-the-art methods.Keywords
Funding Information
- National Natural Science Foundation of China (62172256, 62202272, 62202278)
- Natural Science Foundation of Shandong Province (ZR2019ZD06)
- Young Scholars Program of Shandong University
This publication has 52 references indexed in Scilit:
- Visual Prompt Tuning2022
- Learning to Prompt for Vision-Language ModelsInternational Journal of Computer Vision, 2022
- Learning attention-guided pyramidal features for few-shot fine-grained recognitionPattern Recognition, 2022
- Fine-Grained Visual Classification via Progressive Multi-granularity Training of Jigsaw Patches2020
- Revisiting Local Descriptor Based Image-To-Class Measure for Few-Shot Learning2019
- Meta-Learning With Differentiable Convex Optimization2019
- Few-Shot Learning With Localization in Realistic Settings2019
- Learning to Compare: Relation Network for Few-Shot Learning2018
- The iNaturalist Species Classification and Detection Dataset2018
- Deep Residual Learning for Image Recognition2016