Text-Guided Distribution Calibration for Few-Shot Object Detection in Remote Sensing Images
Open Access
- 24 June 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 18 (19391404) , 17671-17686
Abstract
In recent years, few-shot object detection(FSOD) in remote sensing images(RSIs) has received increasing attention. However, due to the large difference in the number of labeled samples between the base classes and the novel classes, using only visual information for object detection will cause the features learned by the model to be biased towards the base classes, resulting in poor generalization ability in the novel classes with scarce labeled samples. In this paper, we propose a Text-guided distribution calibration network for few-shot object detection on RSIs. Considering the limited visual information of the novel classes, we propose a cross-modal knowledge transfer strategy, which aims to extract the corresponding text feature of the object class name through a multi-modal pre-training model CLIP and transfer the text knowledge to the FSOD model, to mitigate the feature bias problem. Following this idea, we design a text-guided distribution calibration module(TDCM), for each query image which utilizes the intra-image object class distribution defined by the text features to calibrate the object class distribution computed based on the visual features using a knowledge distillation loss for model training. By doing this, the cross-class transferable text knowledge can be transferred to regularize the learned visual features step siding bias on base classes and thus improve the generalization capacity. We conducted experiments on the NWPU VHR-10 and DIOR datasets and clarified the superior performance of the proposed method compared with several state-of-the-art comparison methods.Keywords
Funding Information
- Youth Innovation Promotion Association XIOPM-CAS (XIOPMQCH2023013)
This publication has 52 references indexed in Scilit:
- Uncertainty estimation in HDR imaging with Bayesian neural networksPattern Recognition, 2024
- Few-shot object detection on aerial imagery via deep metric learning and knowledge inheritanceInternational Journal of Applied Earth Observation and Geoinformation, 2023
- Generalized few-shot object detection in remote sensing imagesISPRS Journal of Photogrammetry and Remote Sensing, 2022
- Multiple attention encoded cascade R-CNN for scene text detectionJournal of Visual Communication and Image Representation, 2021
- Detection and Semantic Segmentation of Disaster Damage in UAV FootageJournal of Computing in Civil Engineering, 2021
- End-to-End Object Detection with Transformers2020
- Object detection in optical remote sensing images: A survey and a new benchmarkISPRS Journal of Photogrammetry and Remote Sensing, 2020
- ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design2018
- Graph-based bag-of-words for classificationPattern Recognition, 2018
- Multi-class geospatial object detection and geographic image classification based on collection of part detectorsISPRS Journal of Photogrammetry and Remote Sensing, 2014