LMDENet: A Lightweight RGB-IR Object Detection Network for Low-Light Remote Sensing Images
Top Cited Papers
Open Access
Abstract
RGB-infrared (RGB-IR) object detection leverages complementary information from these two modalities to substantially enhance perception in complex environments, which is particularly beneficial for reliable detection under adverse imaging conditions such as low illumination and severe haze. However, RGB-IR object detection still faces several challenges due to pronounced intra-modality and cross-modality discrepancies. On the one hand, many existing approaches rely on complex architectures to strengthen cross-modal interactions, which increases computational cost. On the other hand, symmetric dual-branch backbones with a static fusion paradigm often struggle to explicitly characterize discrepancies between the RGB and IR modalities. This limitation prevents effective mining of complementary information and reduces the discriminability of fused representations. To address these issues, this paper presents a lightweight RGB-IR multimodal detection network (LMDENet), which consists of three key components: (1) an illumination-guided label selection (IGLS) that integrates RGB and IR labels based on cross-modal matching and illumination-aware rules to construct consistent and reliable supervision; (2) a heterogeneous backbone network (HBN) with differentiated branches that separately model RGB appearance details and IR structural information, improving modality-specific representation learning; and (3) a difference-complement enhancement module (DCEM) that explicitly decomposes cross-modal features into common and difference components and performs selective enhancement to amplify complementary information while suppressing redundant noise. We systematically evaluate the detection performance of the proposed model on the multimodal remote sensing dataset DroneVehicle, and further conduct supplementary experiments on the LLVIP dataset to verify its generalization ability across different scenarios. Experimental results on the DroneVehicle and LLVIP datasets demonstrate that LMDENet achieves and mAP@0.5, respectively. Meanwhile, the model contains only 3.3 M parameters and 8.7 G FLOPs, reflecting a favorable accuracy–efficiency balance.
Keywords
Funding Information
- National Natural Science Foundation of China (62472010)
- Beijing Technology and Business University Young Faculty Scientific Research Start-up Fund (QNJJ2022-45)
This publication has 36 references indexed in Scilit:
- MIR-YOLO: Remote sensing small target detection network based on visible-infrared dual modalityDigital Signal Processing, 2025
- Differential multimodal fusion algorithm for remote sensing object detection through multi-branch feature extractionExpert Systems with Applications, 2024
- DEYOLO: Dual-Feature-Enhancement YOLO for Cross-Modality Object Detection2024
- Channel prior convolutional attention for medical image segmentationComputers in Biology and Medicine, 2024
- Improving RGB-infrared object detection with cascade alignment-guided transformerInformation Fusion, 2024
- RADC-Net:A residual augment-convolutions and adaptive deformable convolution for points-based anchor-free orientation detection network in remote sensing imagesExpert Systems with Applications, 2023
- ICAFusion: Iterative cross-attention guided feature fusion for multispectral object detectionPattern Recognition, 2023
- Deep learning in multimodal remote sensing data fusion: A comprehensive reviewInternational Journal of Applied Earth Observation and Geoinformation, 2022
- Cross-modality attentive feature fusion for object detection in multispectral remote sensing imageryPattern Recognition, 2022
- PIAFusion: A progressive infrared and visible image fusion network based on illumination awareInformation Fusion, 2022