Nengshuang Zhang

Object detection in remote sensing images is crucial for airport management, hazard prevention, traffic monitoring, and more. The precise ability for object localization and identification enables remote sensing imagery to provide early warnings, mitigate risks, and offer strong support for decision-making processes. While traditional deep learning-based object detection techniques have achieved significant results in single-modal environments, their detection capabilities still encounter challenges when confronted with complex environments, such as adverse weather conditions or situations where objects are obscured. To overcome the limitations of existing fusion methods in terms of complexity and insufficient information utilization, we innovatively propose a Cosine Similarity-based Image Feature Fusion (CSIFF) module and integrate it into a dual-branch YOLOv8 network, constructing a lightweight and efficient target detection network called Multi-Modality YOLO Fusion Network (MMYFNet). This network utilizes cosine similarity to divide the original features into common features and specific features, which are then refined and fused through specific modules. Experimental and analytical results show that MMYFNet performs excellently on both the VEDAI and FLIR datasets, achieving mAP values of 80% and 76.8%, respectively. Further validation through parameter sensitivity experiments, ablation studies, and visual analyses confirms the effectiveness of the CSIFF module. MMYFNet achieves high detection accuracy with fewer parameters, and the CSIFF module, as a plug-and-play module, can be integrated into other CNN-based cross-modality network models, providing a new approach for object detection in remote sensing image fusion.

Infrared Small Target (IST) detection involves identifying objects that occupy fewer than 81pixels in a 256×256 image. Because the target is small and lacks texture, structure, and shape information on its surface, this task is highly challenging. CNN-based methods can extract rich features of the target. However, overly deep network structures may increase the risk of losing small targets. Additionally, pixel-level positional deviations can also reduce the detection accuracy of IST. To address these challenges, we propose the Location-Guided Dense Nested Attention Network (LG-DNANet) for IST detection. The proposed network consists of a Pixel Attention Guided Feature Extraction Module (PAG-FEM), a Channel Attention Guided Feature Fusion Module (CAG-FFM), and a detection module. Firstly, the pixel attention-guided feature extraction module utilizes the DNIM dense nested blocks from the DNANet as the backbone, integrating both channel and pixel attention mechanisms. This method focuses on the semantic and positional information of the targets, yielding semantic features that emphasize the positions of small targets. Secondly, the channel attention guided feature fusion module employs upsampling and convolution operations to align the feature sizes, while utilizing the channel attention mechanism to obtain effective channel information. Then, these features are fused through stacking, addition, and averaging operations to obtain more discriminative features. Finally, the detection module uses eight-connected neighborhood clustering method to obtain the centroid coordinates of the targets for subsequent detection evaluation.Three datasets are utilized to verify our method, and experimental results show that our method performs better than other advanced methods.