Abstract
Infrared small target detection (IRSTD) aims to tackle the tough issue of identifying dim and tiny targets in low signal-to-noise ratio (SNR) images, which is crucial for real-world applications such as surveillance, military, and marine rescue. Recent breakthroughs in deep learning have driven IRSTD advancements. However, these methods treat it as a pure black-box paradigm, neglecting the inherent physics of infrared images. This issue significantly affects the model’s accuracy, resulting in lower performance and increased false alarms. Furthermore, existing datasets are limited to about 1,000 samples per benchmark, whereas RGB datasets offer richer samples and information. Inspired by the fact that low SNR and the scarcity of datasets greatly challenge performance, we propose a novel IRSTD network with RGB prior guidance and physics feature fusion (IRPNet). Specifically, an image encoder of CLIP including rich RGB prior information is first employed to integrate RGB knowledge into IRSTD to enrich the model’s representational capacity. Subsequently, infrared-specific visual features are extracted using convolutional block attention mechanisms to capture complex pixel-level relationships. In parallel, a dedicated physical feature extraction (PFE) block is applied to capture the essential properties of infrared images, complementing purely data-driven approaches. Finally, these features are progressively fused through a physical-visual feature fusion (PVFF) block and a multi-scale feature fusion (MSFF) module to enhance representations. Extensive experiments on NUAA-SIRST, IRSTD-1k, NUDT-SIRST and SIRST-Aug demonstrate that IRPNet outperforms existing state-of-the-art (SOTA) methods, providing a more robust and accurate solution. The source code is available at https://github.com/rayyao/IRPNet.
Funding Information
  • National Natural Science Foundation of China (62172417)
  • National Natural Science Foundation of China (62476189)

This publication has 42 references indexed in Scilit: