Detecting Fine-Grained Airplanes in SAR Images With Sparse Attention-Guided Pyramid and Class-Balanced Data Augmentation
Open Access
- 27 September 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 15 (19391404) , 8586-8599
Abstract
Airplane detection in synthetic aperture radar (SAR) images has drawn much attention owing to the success of deep learning methods. However, the development of fine-grained airplane detection in SAR images is still in a dilemma due to the small interclass variance and the large intraclass variance in complex scenes with strong interference from the background. In addition, the class imbalance problem in multiclass fine-grained airplane recognition also significantly limits the direct application of general deep-learning-based airplane detectors. This article proposes two effective methods to tackle the above two problems, respectively. First, we propose a sparse attention-guided fine-grained pyramid module to simultaneously sample discriminative local features scattered in multiscale layers and adaptively aggregate them with fine-grained attention to better classify subordinate-level airplanes with multiple scales. Second, a simple class-balanced copy-paste data augmentation strategy, which randomly copies an airplane of one category and pastes it onto an image according to the classwise probability, is proposed for class balance. Finally, extensive experiments on one public dataset and three representative deep-learning-based detection benchmarks are conducted to show the effectiveness and generalization of the two proposed methods. The combination of these two methods based on the cascade R-CNN benchmark also won the fifth place in fine-grained airplane detection in SAR images in the 2021 GaoFen Challenge.Keywords
Funding Information
- National Key Research and Development Program of China (2020YFB1709503)
- Beijing Nova Program of Science and Technology (Z191100001119129)
This publication has 55 references indexed in Scilit:
- Aircraft recognition in high resolution SAR images using saliency map and scattering structure features2016
- Compact Bilinear Pooling2016
- Bilinear CNN Models for Fine-Grained Visual Recognition2015
- A Two-Phase Algorithm Based on Kurtosis Curvelet Energy and Unsupervised Spectral Regression for Segmentation of SAR ImagesIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2015
- Unsupervised feature learning based on sparse coding and spectral clustering for segmentation of synthetic aperture radar imagesIET Computer Vision, 2015
- Aircraft Detection in High-Resolution SAR Images Based on a Gradient Textural Saliency MapSensors, 2015
- The application of two-level attention models in deep convolutional neural network for fine-grained image classification2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Deep convolutional neural networks for LVCSR2013
- A New Statistical-Based Kurtosis Wavelet Energy Feature for Texture Recognition of SAR ImagesIEEE Transactions on Geoscience and Remote Sensing, 2012