IRPNet: Infrared Small Target Detection via RGB Prior Guidance and Physics Feature Fusion
- 13 January 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 64 (01962892) , 1-12
Abstract
Infrared small target detection (IRSTD) aims to tackle the tough issue of identifying dim and tiny targets in low signal-to-noise ratio (SNR) images, which is crucial for real-world applications such as surveillance, military, and marine rescue. Recent breakthroughs in deep learning have driven IRSTD advancements. However, these methods treat it as a pure black-box paradigm, neglecting the inherent physics of infrared images. This issue significantly affects the model’s accuracy, resulting in lower performance and increased false alarms. Furthermore, existing datasets are limited to about 1,000 samples per benchmark, whereas RGB datasets offer richer samples and information. Inspired by the fact that low SNR and the scarcity of datasets greatly challenge performance, we propose a novel IRSTD network with RGB prior guidance and physics feature fusion (IRPNet). Specifically, an image encoder of CLIP including rich RGB prior information is first employed to integrate RGB knowledge into IRSTD to enrich the model’s representational capacity. Subsequently, infrared-specific visual features are extracted using convolutional block attention mechanisms to capture complex pixel-level relationships. In parallel, a dedicated physical feature extraction (PFE) block is applied to capture the essential properties of infrared images, complementing purely data-driven approaches. Finally, these features are progressively fused through a physical-visual feature fusion (PVFF) block and a multi-scale feature fusion (MSFF) module to enhance representations. Extensive experiments on NUAA-SIRST, IRSTD-1k, NUDT-SIRST and SIRST-Aug demonstrate that IRPNet outperforms existing state-of-the-art (SOTA) methods, providing a more robust and accurate solution. The source code is available at https://github.com/rayyao/IRPNet.Keywords
Funding Information
- National Natural Science Foundation of China (62172417)
- National Natural Science Foundation of China (62476189)
This publication has 42 references indexed in Scilit:
- Infrared Small Target Detection with Scale and Location Sensitivity2024
- Infrared dim target detection via hand-crafted features and deep information combination2022
- ISNet: Shape Matters for Infrared Small Target Detection2022
- ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed dataISPRS Journal of Photogrammetry and Remote Sensing, 2020
- Reweighted Infrared Patch-Tensor Model With Both Nonlocal and Local Priors for Single-Frame Small Target DetectionIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2017
- Non-negative infrared patch-image model: Robust target-background separation via partial sum minimization of singular valuesInfrared Physics & Technology, 2017
- Multiscale patch-based contrast measure for small infrared target detectionPattern Recognition, 2016
- Area under the Precision-Recall Curve: Point Estimates and Confidence Intervals2013
- Analysis of new top-hat transformation and the application for infrared dim small target detectionPattern Recognition, 2010
- Constrained subpixel target detection for remotely sensed imageryIEEE Transactions on Geoscience and Remote Sensing, 2000