Abstract
Object detection in unmanned aerial vehicle (UAV) images poses significant challenges due to complex scale variations and class imbalance among objects. Existing methods often address these challenges separately, overlooking the intricate nature of UAV images and the potential synergy between them. In response, this paper proposes AD-Det, a novel framework employing a coherent coarse-to-fine strategy that seamlessly integrates two pivotal components: adaptive small object enhancement (ASOE) and dynamic class-balanced copy–paste (DCC). ASOE utilizes a high-resolution feature map to identify and cluster regions containing small objects. These regions are subsequently enlarged and processed by a fine-grained detector. On the other hand, DCC conducts object-level resampling by dynamically pasting tail classes around the cluster centers obtained by ASOE, maintaining a dynamic memory bank for each tail class. This approach enables AD-Det to not only extract regions with small objects for precise detection but also dynamically perform reasonable resampling for tail-class objects. Consequently, AD-Det enhances the overall detection performance by addressing the challenges of scale variations and class imbalance in UAV images through a synergistic and adaptive framework. We extensively evaluate our approach on two public datasets, i.e., VisDrone and UAVDT, and demonstrate that AD-Det significantly outperforms existing competitive alternatives. Notably, AD-Det achieves a 37.5% average precision (AP) on the VisDrone dataset, surpassing its counterparts by at least 3.1%.
Funding Information
  • Natural Science Foundation of Fujian Province of China (2023J05117, JAT220017, 62461026, 20232BAB203057)
  • Education and Scientific Research Project for Middle-Aged and Young Teachers in Fujian Province (2023J05117, JAT220017, 62461026, 20232BAB203057)
  • National Natural Science Foundation of China (2023J05117, JAT220017, 62461026, 20232BAB203057)
  • Natural Science Foundation of Jiangxi Province (2023J05117, JAT220017, 62461026, 20232BAB203057)

This publication has 53 references indexed in Scilit: