A Multi-Feature Fusion and Attention Network for Multi-Scale Object Detection in Remote Sensing Images
Open Access
- 16 April 2023
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 15 (8) , 2096
Abstract
Accurate multi-scale object detection in remote sensing images poses a challenge due to the complexity of transferring deep features to shallow features among multi-scale objects. Therefore, this study developed a multi-feature fusion and attention network (MFANet) based on YOLOX. By reparameterizing the backbone, fusing multi-branch convolution and attention mechanisms, and optimizing the loss function, the MFANet strengthened the feature extraction of objects at different sizes and increased the detection accuracy. The ablation experiment was carried out on the NWPU VHR-10 dataset. Our results showed that the overall performance of the improved network was around 2.94% higher than the average performance of every single module. Based on the comparison experiments, the improved MFANet demonstrated a high mean average precision of 98.78% for 9 classes of objects in the NWPU VHR-10 10-class detection dataset and 94.91% for 11 classes in the DIOR 20-class detection dataset. Overall, MFANet achieved an mAP of 96.63% and 87.88% acting on the NWPU VHR-10 and DIOR datasets, respectively. This method can promote the development of multi-scale object detection in remote sensing images and has the potential to serve and expand intelligent system research in related fields such as object tracking, semantic segmentation, and scene understanding.Keywords
Funding Information
- National Natural Science Foundation of China (41975183, 41875184)
This publication has 33 references indexed in Scilit:
- Object detection in optical remote sensing images: A survey and a new benchmarkISPRS Journal of Photogrammetry and Remote Sensing, 2020
- Generalized Intersection Over Union: A Metric and a Loss for Bounding Box Regression2019
- Effective Airplane Detection in Remote Sensing Images Based on Multilayer Feature Fusion and Improved Nonmaximal Suppression AlgorithmRemote Sensing, 2019
- Receptive Field Block Net for Accurate and Fast Object Detection2018
- YOLO9000: Better, Faster, Stronger2017
- A survey on object detection in optical remote sensing imagesISPRS Journal of Photogrammetry and Remote Sensing, 2016
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Deep Residual Learning for Image Recognition2016
- You Only Look Once: Unified, Real-Time Object Detection2016
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014