Few-Shot Object Detection for Remote Sensing Imagery Using Segmentation Assistance and Triplet Head
Open Access
- 29 September 2024
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 16 (19) , 3630
Abstract
The emergence of few-shot object detection provides a new approach to address the challenge of poor generalization ability due to data scarcity. Currently, extensive research has been conducted on few-shot object detection in natural scene datasets, and notable progress has been made. However, in the realm of remote sensing, this technology is still lagging behind. Furthermore, many established methods rely on two-stage detectors, prioritizing accuracy over speed, which hinders real-time applications. Considering both detection accuracy and speed, in this paper, we propose a simple few-shot object detection method based on the one-stage detector YOLOv5 with transfer learning. First, we propose a Segmentation Assistance (SA) module to guide the network’s attention toward foreground targets. This module assists in training and enhances detection accuracy without increasing inference time. Second, we design a novel detection head called the Triplet Head (Tri-Head), which employs a dual distillation mechanism to mitigate the issue of forgetting base-class knowledge. Finally, we optimize the classification loss function to emphasize challenging samples. Evaluations on the NWPUv2 and DIOR datasets showcase the method’s superiority.Keywords
Funding Information
- National Natural Science Foundation of China (62371362)
This publication has 44 references indexed in Scilit:
- Few-shot object detection based on positive-sample improvementDefence Technology, 2023
- Few-shot object detection on aerial imagery via deep metric learning and knowledge inheritanceInternational Journal of Applied Earth Observation and Geoinformation, 2023
- Spatial-Transformer and Cross-Scale Fusion Network (STCS-Net) for Small Object Detection in Remote Sensing ImagesJournal of the Indian Society of Remote Sensing, 2023
- Generalized few-shot object detection in remote sensing imagesISPRS Journal of Photogrammetry and Remote Sensing, 2022
- Bi-path Combination YOLO for Real-time Few-shot Object DetectionPattern Recognition Letters, 2022
- Tools, techniques, datasets and application areas for object detection in an image: a reviewMultimedia Tools and Applications, 2022
- Object detection in optical remote sensing images: A survey and a new benchmarkISPRS Journal of Photogrammetry and Remote Sensing, 2020
- Multi-class geospatial object detection and geographic image classification based on collection of part detectorsISPRS Journal of Photogrammetry and Remote Sensing, 2014
- The Pascal Visual Object Classes Challenge: A RetrospectiveInternational Journal of Computer Vision, 2014
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009