Extreme R-CNN: Few-Shot Object Detection via Sample Synthesis and Knowledge Distillation
Open Access
Abstract
Traditional object detectors require extensive instance-level annotations for training. Conversely, few-shot object detectors, which are generally fine-tuned using limited data from unknown classes, tend to show biases toward base categories and are susceptible to variations within these unknown samples. To mitigate these challenges, we introduce a Two-Stage Fine-Tuning Approach (TFA) named Extreme R-CNN, designed to operate effectively with extremely limited original samples through the integration of sample synthesis and knowledge distillation. Our approach involves synthesizing new training examples via instance clipping and employing various data-augmentation techniques. We enhance the Faster R-CNN architecture by decoupling the regression and classification components of the Region of Interest (RoI), allowing synthetic samples to train the classification head independently of the object-localization process. Comprehensive evaluations on the Microsoft COCO and PASCAL VOC datasets demonstrate significant improvements over baseline methods. Specifically, on the PASCAL VOC dataset, the average precision for novel categories is enhanced by up to 15 percent, while on the more complex Microsoft COCO benchmark it is enhanced by up to 6.1 percent. Remarkably, in the 1-shot scenario, the AP50 of our model exceeds that of the baseline model in the 10-shot setting within the PASCAL VOC dataset, confirming the efficacy of our proposed method.Keywords
Funding Information
- Science and Technology Development Fund (FDCT) of Macau (0071/2022/A, 0095/2023/RIA2)
This publication has 34 references indexed in Scilit:
- STFNet: Self-Supervised Transformer for Infrared and Visible Image FusionIEEE Transactions on Emerging Topics in Computational Intelligence, 2024
- An Attention Mechanism Based AVOD Network for 3D Vehicle DetectionIEEE Transactions on Intelligent Vehicles, 2023
- Bounding convolutional network for refining object locationsNeural Computing and Applications, 2023
- Delving into Inter-Image Invariance for Unsupervised Visual RepresentationsInternational Journal of Computer Vision, 2022
- Few-shot Object Detection and Viewpoint Estimation for Objects in the WildIEEE Transactions on Pattern Analysis and Machine Intelligence, 2022
- Dual-Awareness Attention for Few-Shot Object DetectionIEEE Transactions on Multimedia, 2021
- Multi-scale Positive Sample Refinement for Few-Shot Object Detection2020
- Smart Augmentation Learning an Optimal Data Augmentation StrategyIEEE Access, 2017
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- The Pascal Visual Object Classes Challenge: A RetrospectiveInternational Journal of Computer Vision, 2014