Lei Zhang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Lei Zhang has a total of 9 co-authors. Here are the top co-authors by number of shared publications:
- Wenyu Shao
School of Artificial Intelligence, Dalian Maritime University, Dalian, China
2 shared publications - Yanlin Chen
School of Applied Science, Taiyuan University of Science and Technology, Taiyuan, China
2 shared publications - Zhishe Wang
School of Applied Science, Taiyuan University of Science and Technology, Taiyuan, China
2 shared publications Fengbao Yang
North University of China, Taiyuan, China
1 shared publication- Hui Li
Jiangnan University, Wuxi, China
1 shared publication - Jiawei Xu
Key Laboratory of Intelligent Informatics for Safety and Emergency of Zhejiang Province, Wenzhou University, Wenzhou, China
1 shared publication
Latest Publications
- 25 January 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 33 (8) , 3677-3688
A Cross-Scale Iterative Attentional Adversarial Fusion Network for Infrared and Visible Images
Recent existing methods generally adopt a simple concatenation or addition strategy to integrate features at the fusion layer, failing to adequately consider the intrinsic characteristics of different modal images and feature interaction of different scales, which may produce a limited fusion performance. Toward this end, we introduce a cross-scale iterative attentional adversarial fusion network, namely CrossFuse. More specifically, in the generator, we design a cross-modal attention integrated module to merge the intrinsic content of different modal images. The parallel spatial-independent and channel-independent pathways are proposed to calculate the attentional weights, which are assigned to measure the activity levels of source images at the same scale. Moreover, we construct a cross-scale iterative decoder framework to interact with different modality features at different scales, which can constantly optimize their activity levels. By this means, the generator learns to integrate their modality characteristics via attentional weights in an iterative manner, and the generated result characterizes competitive infrared radiant intensity and distinct visible detail description. Extensive experiments on three different benchmarks demonstrate that our CrossFuse outperforms other nine state-of-the-art methods in terms of fusion performance, generalization ability and computational efficiency. Our codes will be released at https://github.com/Zhishe-Wang/CrossFuse.
- 25 January 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 33 (8) , 3677-3688
A Cross-Scale Iterative Attentional Adversarial Fusion Network for Infrared and Visible Images
Recent existing methods generally adopt a simple concatenation or addition strategy to integrate features at the fusion layer, failing to adequately consider the intrinsic characteristics of different modal images and feature interaction of different scales, which may produce a limited fusion performance. Toward this end, we introduce a cross-scale iterative attentional adversarial fusion network, namely CrossFuse. More specifically, in the generator, we design a cross-modal attention integrated module to merge the intrinsic content of different modal images. The parallel spatial-independent and channel-independent pathways are proposed to calculate the attentional weights, which are assigned to measure the activity levels of source images at the same scale. Moreover, we construct a cross-scale iterative decoder framework to interact with different modality features at different scales, which can constantly optimize their activity levels. By this means, the generator learns to integrate their modality characteristics via attentional weights in an iterative manner, and the generated result characterizes competitive infrared radiant intensity and distinct visible detail description. Extensive experiments on three different benchmarks demonstrate that our CrossFuse outperforms other nine state-of-the-art methods in terms of fusion performance, generalization ability and computational efficiency. Our codes will be released at https://github.com/Zhishe-Wang/CrossFuse.
- Top Cited Papers
- 18 July 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 71 (00189456) , 1-12
SwinFuse: A Residual Swin Transformer Fusion Network for Infrared and Visible Images
The existing deep learning fusion methods mainly concentrate on convolutional neural networks (CNNs), and few attempts are made with transformer. Meanwhile, the convolutional operation is a content-independent interaction between the image and the convolution kernel, which may lose some important contexts and further limit fusion performance. Toward this end, we present a simple and strong fusion baseline for infrared and visible images, namely, residual Swin Transformer fusion network, termed SwinFuse. Our SwinFuse includes three parts: the global feature extraction, fusion layer, and feature reconstruction. In particular, we build a fully attentional feature encoding backbone to model the long-range dependencies, which is a pure transformer network and has a stronger representation ability compared with the CNNs. Moreover, we design a novel feature fusion strategy based on the $L_{1}$ -norm for sequence matrices and measure the corresponding activity levels from row and column vector dimensions, which can well retain competitive infrared brightness and distinct visible details. Finally, we testify our SwinFuse with nine state-of-the-art traditional and deep learning methods on three different datasets through subjective observations and objective comparisons, and the experimental results manifest that the proposed SwinFuse obtains surprising fusion performance with strong generalization ability and competitive computational efficiency. The code will be available at https://github.com/Zhishe-Wang/SwinFuse .
- 18 July 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 71 (00189456) , 1-12
Top Cited PapersSwinFuse: A Residual Swin Transformer Fusion Network for Infrared and Visible Images
The existing deep learning fusion methods mainly concentrate on convolutional neural networks (CNNs), and few attempts are made with transformer. Meanwhile, the convolutional operation is a content-independent interaction between the image and the convolution kernel, which may lose some important contexts and further limit fusion performance. Toward this end, we present a simple and strong fusion baseline for infrared and visible images, namely, residual Swin Transformer fusion network, termed SwinFuse. Our SwinFuse includes three parts: the global feature extraction, fusion layer, and feature reconstruction. In particular, we build a fully attentional feature encoding backbone to model the long-range dependencies, which is a pure transformer network and has a stronger representation ability compared with the CNNs. Moreover, we design a novel feature fusion strategy based on the $L_{1}$ -norm for sequence matrices and measure the corresponding activity levels from row and column vector dimensions, which can well retain competitive infrared brightness and distinct visible details. Finally, we testify our SwinFuse with nine state-of-the-art traditional and deep learning methods on three different datasets through subjective observations and objective comparisons, and the experimental results manifest that the proposed SwinFuse obtains surprising fusion performance with strong generalization ability and competitive computational efficiency. The code will be available at https://github.com/Zhishe-Wang/SwinFuse .
- 15 March 2022
- Published by Springer Nature in Multimedia Tools and Applications
- Vol. 81 (15) , 21369-21384
Multi-modal image fusion with the hybrid ℓ0ℓ1 layer decomposing and multi-directional filter banks
- 15 March 2022
- Published by Springer Nature in Multimedia Tools and Applications
- Vol. 81 (15) , 21369-21384
Multi-modal image fusion with the hybrid ℓ0ℓ1 layer decomposing and multi-directional filter banks