Zhenlin Zhu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Zhenlin Zhu has a total of 15 co-authors. Here are the top co-authors by number of shared publications:
- Changxin Gao
Huazhong University of Science and Technology
4 shared publications - Hua Chen
School of Information Science and Engineering, Hunan Normal University, Changsha, China
4 shared publications - Nong Sang
Huazhong University of Science and Technology
4 shared publications - Runmin Wang
Hunan Normal University, Changsha, China
4 shared publications - Yanbin Zhu
School of Information Science and Engineering, Hunan Normal University, Changsha, China
4 shared publications - Yajun Ding
School of Information Science and Engineering, Hunan Normal University, Changsha, China
3 shared publications
Latest Publications
- 19 February 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 36 (8) , 14691-14705
S3INet: Semantic-Information Space Sharing Interaction Network for Arbitrary Shape Text Detection
The detecting arbitrary shape text is a challenging task due to the significant variation in text shape, size, and aspect ratio, as well as the complexity of scene backgrounds. The enhancing feature extraction capabilities is essential for the boosting text detection accuracy. However, traditional text feature extraction methods face several issues, including insufficient multiscale feature fusion, limited information transfer between different feature levels, and constrained receptive field expansion when using asymmetric convolutional kernels for long text detection. To address these challenges, this article introduces an arbitrarily shaped scene text detector called the semantic-information space sharing interaction network (S3INet). The proposed network leverages the semantic-information space sharing module (S3M) to generate a single-level feature map capable of capturing multiscale features with rich semantic information and prominent foreground elements. In addition, we propose the multibranch parallel asymmetric convolutional module (MPACM) group to enhance the representation of text features, thereby further enhancing text detection performance. Extensive experimental evaluations on five publicly available natural scene text datasets (CTW-1500, Total-Text, MSRA-TD500, ICDAR2015, and ICDAR2017-MLT) and two traffic text datasets (CTST-1600 and TPD) demonstrate the superiority of our method. The results indicate that S3INet significantly outperforms most existing state-of-the-art methods in both accuracy and robustness. The code will be released at: https://github.com/runminwang/S3INet.
- 19 February 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 36 (8) , 14691-14705
S3INet: Semantic-Information Space Sharing Interaction Network for Arbitrary Shape Text Detection
The detecting arbitrary shape text is a challenging task due to the significant variation in text shape, size, and aspect ratio, as well as the complexity of scene backgrounds. The enhancing feature extraction capabilities is essential for the boosting text detection accuracy. However, traditional text feature extraction methods face several issues, including insufficient multiscale feature fusion, limited information transfer between different feature levels, and constrained receptive field expansion when using asymmetric convolutional kernels for long text detection. To address these challenges, this article introduces an arbitrarily shaped scene text detector called the semantic-information space sharing interaction network (S3INet). The proposed network leverages the semantic-information space sharing module (S3M) to generate a single-level feature map capable of capturing multiscale features with rich semantic information and prominent foreground elements. In addition, we propose the multibranch parallel asymmetric convolutional module (MPACM) group to enhance the representation of text features, thereby further enhancing text detection performance. Extensive experimental evaluations on five publicly available natural scene text datasets (CTW-1500, Total-Text, MSRA-TD500, ICDAR2015, and ICDAR2017-MLT) and two traffic text datasets (CTST-1600 and TPD) demonstrate the superiority of our method. The results indicate that S3INet significantly outperforms most existing state-of-the-art methods in both accuracy and robustness. The code will be released at: https://github.com/runminwang/S3INet.
- 24 October 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 25 (12) , 19770-19784
TTDNet: An End-to-End Traffic Text Detection Framework for Open Driving Environments
Traffic text detection is crucial for traffic scene understanding in intelligent transportation systems (ITS). Although natural scene text detection has been extensively studied, yielding noteworthy results, little research has focused on traffic text detection. Traffic text, as a special type of natural scene text, faces not only the general challenges of natural scene text detection but also the significant impact of false alarms from non-traffic texts on system performance. In light of these challenges, we propose an end-to-end traffic text detection framework that can effectively detect traffic text captured by in-vehicle cameras in various driving scenarios. The key contributions of our proposed approach are: (1) an Image Enhancement Module designed to remove fog and enhance low-quality images; (2) a plug-and-play Text Feature Enhancement Module; (3) a Joint Loss Function; and (4) the creation of an open driving environment traffic text dataset (named ODETT-3000) containing various traffic environments. Comprehensive experimental studies have verified that our method achieves state-of-the-art performance on traffic text datasets such as CTST-1600, TPD, and ODETT-3000, as well as promising results on public natural scene text datasets such as MSRA-TD500, ICDAR 2015, and CTW 1500, thereby showcasing the superior performance and adaptability of our method. The code and our dataset (ODETT-3000) will be available at https://github.com/yanbin-zhu/TTDNet.
- 24 October 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 25 (12) , 19770-19784
TTDNet: An End-to-End Traffic Text Detection Framework for Open Driving Environments
Traffic text detection is crucial for traffic scene understanding in intelligent transportation systems (ITS). Although natural scene text detection has been extensively studied, yielding noteworthy results, little research has focused on traffic text detection. Traffic text, as a special type of natural scene text, faces not only the general challenges of natural scene text detection but also the significant impact of false alarms from non-traffic texts on system performance. In light of these challenges, we propose an end-to-end traffic text detection framework that can effectively detect traffic text captured by in-vehicle cameras in various driving scenarios. The key contributions of our proposed approach are: (1) an Image Enhancement Module designed to remove fog and enhance low-quality images; (2) a plug-and-play Text Feature Enhancement Module; (3) a Joint Loss Function; and (4) the creation of an open driving environment traffic text dataset (named ODETT-3000) containing various traffic environments. Comprehensive experimental studies have verified that our method achieves state-of-the-art performance on traffic text datasets such as CTST-1600, TPD, and ODETT-3000, as well as promising results on public natural scene text datasets such as MSRA-TD500, ICDAR 2015, and CTW 1500, thereby showcasing the superior performance and adaptability of our method. The code and our dataset (ODETT-3000) will be available at https://github.com/yanbin-zhu/TTDNet.
- 15 January 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 26 (15209210) , 6513-6528
DIMGNet: A Transformer-Based Network for Pedestrian Reidentification With Multi-Granularity Information Mutual Gain
Pedestrian reidentification (ReID) is a challenging task that involves identifying and retrieving specific pedestrians across different cameras and scenes. This problem has significant implications for security surveillance, and has thus received substantial attention in recent years. However, traditional convolutional neural networks (CNNs) have limited receptive fields and cannot capture global information. Moreover, transformer networks, which excel in long-range feature capture, are prone to accuracy degradation due to loss of details. To address these limitations, we propose a transformer-based pedestrian ReID network with double-branch information mutual gain (DIMGNet), which leverages hierarchical parallel levels to support multi-granularity feature information mutual gain. Our model also incorporates an auxiliary camera information (ACI) module to improve feature representation ability. We further embed a cross-attention mechanism into the architecture to enhance mutual gain between multi-granularity features and improve feature discrimination. Finally, we introduce a shuffling technique to increase the robustness of the extracted features. We evaluate the proposed method on several benchmark datasets, including Market-1501[1], MSMT17[2], DukeMTMC-reID [3], and Occluded-Duke [4], achieving $mAP$ values of 90.7%, 68.4%, 83.7%, and 60.6%, respectively. Our method outperforms most state-of-the-art methods, demonstrating the effectiveness of our method. The code will be publicly released at https://github.com/ZhenlinZhu/DIMGNet .
- 15 January 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 26 (15209210) , 6513-6528
DIMGNet: A Transformer-Based Network for Pedestrian Reidentification With Multi-Granularity Information Mutual Gain
Pedestrian reidentification (ReID) is a challenging task that involves identifying and retrieving specific pedestrians across different cameras and scenes. This problem has significant implications for security surveillance, and has thus received substantial attention in recent years. However, traditional convolutional neural networks (CNNs) have limited receptive fields and cannot capture global information. Moreover, transformer networks, which excel in long-range feature capture, are prone to accuracy degradation due to loss of details. To address these limitations, we propose a transformer-based pedestrian ReID network with double-branch information mutual gain (DIMGNet), which leverages hierarchical parallel levels to support multi-granularity feature information mutual gain. Our model also incorporates an auxiliary camera information (ACI) module to improve feature representation ability. We further embed a cross-attention mechanism into the architecture to enhance mutual gain between multi-granularity features and improve feature discrimination. Finally, we introduce a shuffling technique to increase the robustness of the extracted features. We evaluate the proposed method on several benchmark datasets, including Market-1501[1], MSMT17[2], DukeMTMC-reID [3], and Occluded-Duke [4], achieving $mAP$ values of 90.7%, 68.4%, 83.7%, and 60.6%, respectively. Our method outperforms most state-of-the-art methods, demonstrating the effectiveness of our method. The code will be publicly released at https://github.com/ZhenlinZhu/DIMGNet .
- Open Access
- 1 January 2023
- Published by World Scientific Pub Co Pte Ltd in Fractals
- Vol. 31 (06)
FTN–VQA: MULTIMODAL REASONING BY LEVERAGING A FULLY TRANSFORMER-BASED NETWORK FOR VISUAL QUESTION ANSWERING
Visual Question Answering (VQA) is a multimodal task, which requires understanding the information in the natural language questions and paying attention to the useful information in the images. So far, the solution of VQA tasks can be divided into grid-based methods and bottom-up-based methods. The grid-based method directly extracts the semantic features of the image by leveraging the convolution neural network (CNN), so it has a praiseworthy computational efficiency, but the global convolution feature ignores the information of the key area and causes the performance bottleneck. The bottom-up-based method needs to detect potentially problem-related objects by using some object detection frameworks, e.g. Faster RCNN, so it has better performance, but the computational efficiency is reduced due to the computation of Region Proposal Network (RPN) and Non-Maximum Suppression (NMS). Based on the aforementioned reasons, we propose a fully transformer-based network (FTN) that can maintain a balance between computational efficiency and accuracy, which can be trained end-to-end and consists of three components: question module, image module, and fusion module. Meanwhile, the image module and the question module are visualized to explore the operating rules of the transformer. The experiment results demonstrate that the FTN can focus on key information and objects in the question module and the image module, and our single model has reached 69.01% accuracy on the VQA2.0 dataset, which is superior to the grid-based methods. Although FTN fails to surpass a few state-of-the-art bottom-up-based methods, the FTN has obvious advantages in computational efficiency. The code will be released at https://github.com/weixiang-xu/FTN-VQA.git.
- 1 January 2023
- Published by World Scientific Pub Co Pte Ltd in Fractals
- Vol. 31 (06)
Open AccessFTN–VQA: MULTIMODAL REASONING BY LEVERAGING A FULLY TRANSFORMER-BASED NETWORK FOR VISUAL QUESTION ANSWERING
Visual Question Answering (VQA) is a multimodal task, which requires understanding the information in the natural language questions and paying attention to the useful information in the images. So far, the solution of VQA tasks can be divided into grid-based methods and bottom-up-based methods. The grid-based method directly extracts the semantic features of the image by leveraging the convolution neural network (CNN), so it has a praiseworthy computational efficiency, but the global convolution feature ignores the information of the key area and causes the performance bottleneck. The bottom-up-based method needs to detect potentially problem-related objects by using some object detection frameworks, e.g. Faster RCNN, so it has better performance, but the computational efficiency is reduced due to the computation of Region Proposal Network (RPN) and Non-Maximum Suppression (NMS). Based on the aforementioned reasons, we propose a fully transformer-based network (FTN) that can maintain a balance between computational efficiency and accuracy, which can be trained end-to-end and consists of three components: question module, image module, and fusion module. Meanwhile, the image module and the question module are visualized to explore the operating rules of the transformer. The experiment results demonstrate that the FTN can focus on key information and objects in the question module and the image module, and our single model has reached 69.01% accuracy on the VQA2.0 dataset, which is superior to the grid-based methods. Although FTN fails to surpass a few state-of-the-art bottom-up-based methods, the FTN has obvious advantages in computational efficiency. The code will be released at https://github.com/weixiang-xu/FTN-VQA.git.