Abstract
Infrared and visible image fusion needs to preserve both the salient target of the infrared image and the texture details of the visible image. Therefore, an infrared and visible image fusion method based on saliency detection is proposed. Firstly, the saliency map of the infrared image is obtained by saliency detection. Then, the specific loss function and network architecture are designed based on the saliency map to improve the performance of the fusion algorithm. Specifically, the saliency map is normalized to [0, 1], used as a weight map to constrain the loss function. At the same time, the saliency map is binarized to extract salient regions and nonsalient regions. And, a generative adversarial network with dual discriminators is obtained. The two discriminators are used to distinguish the salient regions and the nonsalient regions, respectively, to promote the generator to generate better fusion results. The experimental results show that the fusion results of our method are better than those of the existing methods in both subjective and objective aspects.
Funding Information
  • National Natural Science Foundation of China (62171327, 62171328, 62072350, 2019AAA045, D20201507, B210610, ZX200302)
  • Hubei Technology Innovation Project (62171327, 62171328, 62072350, 2019AAA045, D20201507, B210610, ZX200302)
  • Hubei Provincial Department of Education (62171327, 62171328, 62072350, 2019AAA045, D20201507, B210610, ZX200302)
  • Hubei Nuclear Power Operation Engineering Technology Research Center (62171327, 62171328, 62072350, 2019AAA045, D20201507, B210610, ZX200302)
  • Nuclear Energy Development Project (62171327, 62171328, 62072350, 2019AAA045, D20201507, B210610, ZX200302)

This publication has 31 references indexed in Scilit: