Contrast Saliency Information Guided Infrared and Visible Image Fusion
- 17 August 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computational Imaging
- Vol. 9 (25730436) , 769-780
Abstract
This study proposes an infrared and visible image fusion method based on contrast saliency information guided, termed CSFusion. On the one hand, the gradual recovery network is devised to achieve self-refining processing and cross-stage integration of encoded features. Specifically, the network establishes one-to-one feature reuse between the encoder and the decoder, which can effectively facilitating the decoder integration and reconstruction of encoded features. Moreover, the introduction of the self-refine attention module (SRAM) effectively refines the encoded information of each branch and reduces the impact of redundant information on image reconstruction. On the other hand, the salient guided module (SGM) built with the edge-preserving filter can effectively output contrast saliency maps of the source images. Its synergistic operation with the objective function drives the fused image generated by the network to exhibit a better background texture while highlighting the content information of the source images. It is worth noting that the SGM as the auxiliary network is utilized only in the training stage. Compared to state-of-the-art methods, extensive experiments of qualitative and quantitative results prove the superiority and robustness of our method. Also, the performance on the object detection task further reveals its potential on high-level vision tasks.Keywords
Funding Information
- Yunnan Expert Workstation (202105AF150011, 202305AF150045)
- National Natural Science Foundation of China (62162065, 61761045)
- Reserve talents for Young and middle-aged academic and technical leaders in Yunnan Province (2019HB121)
- Basic research in Yunnan Province (202201AT070167)
- Yunnan Provincial Department of Education Scientific Research Fund Project (2023Y0246)
This publication has 45 references indexed in Scilit:
- The TNO Multiband Image Data CollectionData in Brief, 2017
- An Adaptive Fusion Algorithm for Visible and Infrared Videos Based on Entropy and the Cumulative Distribution of Gray LevelsIEEE Transactions on Multimedia, 2017
- Infrared and visible image fusion based on visual saliency map and weighted least square optimizationInfrared Physics & Technology, 2017
- Infrared and visible image fusion via gradient transfer and total variation minimizationInformation Fusion, 2016
- Deep Residual Learning for Image Recognition2016
- A general framework for image fusion based on multi-scale transform and sparse representationInformation Fusion, 2015
- Image Fusion With Guided FilteringIEEE Transactions on Image Processing, 2013
- Cognitively-engineered multisensor image fusion for military applicationsInformation Fusion, 2009
- Edge-preserving decompositions for multi-scale tone and detail manipulationACM Transactions on Graphics, 2008
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004