CSChaoqun Sima

Chaoqun Sima

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Chaoqun Sima has a total of 7 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • TextFuse: Text Information Guided Infrared and Visible Image Fusion

    by Guohua Lv, Chaoqun Sima, Juncan Wang, Yongbiao Gao, Zhonghe Wei, Jinyong Cheng

    Image fusion involves integrating the information of multiple source images into one fused image, maximizing each source image's advantages. Existing image fusion methods combining text information mainly focus on enhancing the fusion effect, ignoring the requirements of subsequent tasks. High level task oriented fusion methods are usually limited to image information processing, ignoring the potential of text information at the high-level semantic, such as scene understanding and target recognition. We propose an image fusion method called TextFuse, which combines text information and subsequent task requirements, to guide image fusion through the text description generated by the source image and subsequent task requirements. Specifically, we use the text generation model to generate text descriptions for the source image, and design strategies to generate additional text information for key areas to comprehensively express the content of the source image. In the fusion process, we use text information and detection network to guide the model, so as to enhance the model's understanding of the image, generate a fusion image containing rich semantic information and visual details, and improve the performance in subsequent tasks. The text information provides additional semantic context for the image fusion process, enhances the details of key areas, and significantly improves the quality of the fused image. At the same time, the guidance of subsequent tasks further optimized the performance of fused images in follow-up tasks. Experimental results show that the proposed method is significantly better than the state-of-the-art image fusion methods in terms of visual effect and follow-up task performance. The source code is available at: https://github.com/poison-pig/TextFuse.


  • SIGFusion: Semantic Information-Guided Infrared and Visible Image Fusion

    by Guohua Lv, Chaoqun Sima, Yongbiao Gao, Aimei Dong, Guangxiao Ma, Jinyong Cheng

    In the field of image fusion, the fusion of infrared and visible images emerges as a crucial work, retaining the inherent characteristics of each source image for the creation of high-quality fusion images. However, existing fusion algorithms primarily prioritize visual performance and statistical metrics, often neglecting the requisites of high-level vision tasks. To bridge this gap, our paper proposes SIGFusion, an end-to-end method for infrared and visible image fusion. SIGFusion not only considers the visual performance and statistical metrics of the fused image but also focuses on meeting the demands of subsequent high-level vision tasks, thereby enhancing performance in fusion and high-level vision tasks. Concretely, we define significant semantic information as salient targets presenting in both infrared and visible images. By utilizing targets, our fusion network is guided to enhance these salient targets. In contrast to the isolated employ of either infrared or visible images, our target-based method comprehensively utilizes the semantic information within the image. Additionally, the utilization of target-based self-attention loss enhances the extraction of vital information from the source image. It is worth noting that masks are only necessary during the training stage and are automatically generated through detection algorithms. We conduct experiments in both image fusion and high-level vision tasks. Experimental results demonstrate the effectiveness of SIGFusion in both infrared and visible image fusion tasks, as well as in subsequent high-level vision tasks. The source code is available at https://github.com/poison-pig/SIGFusion.