Dual Appearance-Aware Enhancement for Oriented Object Detection
- 18 December 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 62 (01962892) , 1-14
Abstract
Oriented detectors have become the mainstream of object detection in remote sensing images since they provide more precise bounding boxes and contain less background. However, there remain several challenges that restrict the detection performance and need to be tackled. This paper focuses on the following two aspects: (i) Numerous tiny objects in remote sensing images pose a challenge for the detectors pursuing high recall and accurate localization. (ii) Specific categories with large aspect ratios and arbitrary angles also trouble the regression of the detectors. We attempt to alleviate the above problems by constructing a Weak Feature Extraction Network (WFEN) and a Dual Appearance-aware (DA) Loss. Specifically, WFEN is used to extract hierarchical weight vectors for multiscale feature layers by employing a lightweight convolutional module, aiming to fuse activation features distributed in different layers and provide pure features for subsequent regression and classification. DA loss is tailored to regressions of tiny and slender objects by dynamically modulating the associated loss on objects with various appearances, which consists of two auxiliary losses, termed scale-aware loss L S and aspect-ratio-aware loss L A . These two components can contribute to each other, i.e., the former provides more accurate features for detection tasks, while the latter can reciprocate the former by imposing constraints on crucial objects, and together constitute an Appearance Sensitivity Detector (ASDet). Extensive experiments on three public datasets demonstrate our ASDet outperforms all refine-stage detectors in terms of accuracy while maintaining the superior inference speed of single-stage counterparts.Keywords
Funding Information
- National Natural Science Foundation of China (62036006)
- Key-Area Research and Development Program of Guangdong Province (2020B090921001)
This publication has 49 references indexed in Scilit:
- Towards Multi-class Object Detection in Unconstrained Remote Sensing Imagery2019
- $\mathcal{R}^2$ -CNN: Fast Tiny Object Detection in Large-Scale Remote Sensing ImagesIEEE Transactions on Geoscience and Remote Sensing, 2019
- DOTA: A Large-Scale Dataset for Object Detection in Aerial Images2018
- Arbitrary-Oriented Scene Text Detection via Rotation ProposalsIEEE Transactions on Multimedia, 2018
- Focal Loss for Dense Object Detection2017
- Feature Pyramid Networks for Object Detection2017
- UnitBox2016
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Deep Residual Learning for Image Recognition2016
- Fuzzy C-Means Clustering With Local Information and Kernel Metric for Image SegmentationIEEE Transactions on Image Processing, 2012