A Generative Adversarial Network with Dual Discriminators for Infrared and Visible Image Fusion Based on Saliency Detection
Open Access
- 24 November 2021
- journal article
- research article
- Published by Wiley in Mathematical Problems in Engineering
- Vol. 2021, 1-9
Abstract
Infrared and visible image fusion needs to preserve both the salient target of the infrared image and the texture details of the visible image. Therefore, an infrared and visible image fusion method based on saliency detection is proposed. Firstly, the saliency map of the infrared image is obtained by saliency detection. Then, the specific loss function and network architecture are designed based on the saliency map to improve the performance of the fusion algorithm. Specifically, the saliency map is normalized to [0, 1], used as a weight map to constrain the loss function. At the same time, the saliency map is binarized to extract salient regions and nonsalient regions. And, a generative adversarial network with dual discriminators is obtained. The two discriminators are used to distinguish the salient regions and the nonsalient regions, respectively, to promote the generator to generate better fusion results. The experimental results show that the fusion results of our method are better than those of the existing methods in both subjective and objective aspects.Keywords
Funding Information
- National Natural Science Foundation of China (62171327, 62171328, 62072350, 2019AAA045, D20201507, B210610, ZX200302)
- Hubei Technology Innovation Project (62171327, 62171328, 62072350, 2019AAA045, D20201507, B210610, ZX200302)
- Hubei Provincial Department of Education (62171327, 62171328, 62072350, 2019AAA045, D20201507, B210610, ZX200302)
- Hubei Nuclear Power Operation Engineering Technology Research Center (62171327, 62171328, 62072350, 2019AAA045, D20201507, B210610, ZX200302)
- Nuclear Energy Development Project (62171327, 62171328, 62072350, 2019AAA045, D20201507, B210610, ZX200302)
This publication has 31 references indexed in Scilit:
- Infrared and visible image fusion via gradient transfer and total variation minimizationInformation Fusion, 2016
- A Thermal Infrared and Visible Images Fusion Based Approach for Multitarget Detection under Complex EnvironmentMathematical Problems in Engineering, 2015
- A fusion method for visible and infrared images based on contrast pyramid with teaching learning based optimizationInfrared Physics & Technology, 2014
- Infrared Target Detection and Location for Visual Surveillance Using Fusion Scheme of Visible and Infrared ImagesMathematical Problems in Engineering, 2013
- Technique for image fusion based on non-subsampled contourlet transform domain improved NMFScience China Information Sciences, 2010
- Pixel- and region-based image fusion with complex waveletsInformation Fusion, 2007
- Pixel-based and region-based image fusion schemes using ICA basesInformation Fusion, 2007
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- A model of saliency-based visual attention for rapid scene analysisIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998
- In-fibre Bragg grating sensorsMeasurement Science and Technology, 1997