Lei Wang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Lei Wang has a total of 21 co-authors. Here are the top co-authors by number of shared publications:
- Fang Gao
School of Electrical Engineering, Guangxi University, Nanning, China
2 shared publications - Jun Yu
University of Science and Technology of China, Hefei, China
2 shared publications Chengzhen Huang
1 shared publication- Jing Liu
University of Science and Technology of China
1 shared publication Jun Yu
University of Science and Technology China
1 shared publicationLei Li
University of Science and Technology of China
1 shared publication
Latest Publications
- Open Access
Interactive Multimodal Fusion with Temporal Modeling
This paper presents our method for the estimation of valence-arousal (VA) in the 8th Affective Behavior Analysis in-the-Wild (ABAW) competition. Our approach integrates visual and audio information through a multimodal framework. The visual branch uses a pre-trained ResNet model to extract spatial features from facial images. The audio branches employ pre-trained VGG models to extract VGGish and LogMel features from speech signals. These features undergo temporal modeling using Temporal Convolutional Networks (TCNs). We then apply cross-modal attention mechanisms, where visual features interact with audio features through query-key-value attention structures. Finally, the features are concatenated and passed through a regression layer to predict valence and arousal. Our method achieves competitive performance on the Aff-Wild2 dataset, demonstrating effective multimodal fusion for VA estimation in-the-wild.
Open AccessInteractive Multimodal Fusion with Temporal Modeling
This paper presents our method for the estimation of valence-arousal (VA) in the 8th Affective Behavior Analysis in-the-Wild (ABAW) competition. Our approach integrates visual and audio information through a multimodal framework. The visual branch uses a pre-trained ResNet model to extract spatial features from facial images. The audio branches employ pre-trained VGG models to extract VGGish and LogMel features from speech signals. These features undergo temporal modeling using Temporal Convolutional Networks (TCNs). We then apply cross-modal attention mechanisms, where visual features interact with audio features through query-key-value attention structures. Finally, the features are concatenated and passed through a regression layer to predict valence and arousal. Our method achieves competitive performance on the Aff-Wild2 dataset, demonstrating effective multimodal fusion for VA estimation in-the-wild.
- 29 August 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 26 (15209210) , 10637-10650
Language-Guided Dual-Modal Local Correspondence for Single Object Tracking
This paper focuses on the advancement of single object tracking technologies in computer vision, which have broad applications including robotic vision, video surveillance, and sports video analysis. Current methods relying solely on the target's initial visual information encounter performance bottlenecks and limited applications, due to the scarcity of target semantics in appearance features and the continuous change in the target's appearance. To address these issues, we propose a novel approach, combining visual-language dual-modal single object tracking, that leverages natural language descriptions to enrich the semantic information of the moving target. We introduce a dual-modal single-object tracking algorithm based on local correspondence modeling. The algorithm decomposes visual features into multiple local visual semantic features and pairs them with local language features extracted from natural language descriptions. In addition, we also propose a new global relocalization method that utilizes visual language bimodal information to perceive target disappearance and misalignment and adaptively reposition the target in the entire image. This improves the tracker's ability to adapt to changes in target appearance over long periods of time, enabling long-term single target tracking based on bimodal semantic and motion information. Experimental results show that our model outperforms stateof-the-art methods, which demonstrates the effectiveness and efficiency of our approach
- 29 August 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 26 (15209210) , 10637-10650
Language-Guided Dual-Modal Local Correspondence for Single Object Tracking
This paper focuses on the advancement of single object tracking technologies in computer vision, which have broad applications including robotic vision, video surveillance, and sports video analysis. Current methods relying solely on the target's initial visual information encounter performance bottlenecks and limited applications, due to the scarcity of target semantics in appearance features and the continuous change in the target's appearance. To address these issues, we propose a novel approach, combining visual-language dual-modal single object tracking, that leverages natural language descriptions to enrich the semantic information of the moving target. We introduce a dual-modal single-object tracking algorithm based on local correspondence modeling. The algorithm decomposes visual features into multiple local visual semantic features and pairs them with local language features extracted from natural language descriptions. In addition, we also propose a new global relocalization method that utilizes visual language bimodal information to perceive target disappearance and misalignment and adaptively reposition the target in the entire image. This improves the tracker's ability to adapt to changes in target appearance over long periods of time, enabling long-term single target tracking based on bimodal semantic and motion information. Experimental results show that our model outperforms stateof-the-art methods, which demonstrates the effectiveness and efficiency of our approach
- 22 September 2023
- Published by Springer Nature
- p. 147-159
Cross-Domain Transformer with Adaptive Thresholding for Domain Adaptive Semantic Segmentation
- 22 September 2023
- Published by Springer Nature
- p. 147-159
Cross-Domain Transformer with Adaptive Thresholding for Domain Adaptive Semantic Segmentation
- 17 December 2022
- Published by Springer Nature
- p. 195-207
Crowd-Oriented Behavior Simulation:Reinforcement Learning Framework Embedded with Emotion Model
- 17 December 2022
- Published by Springer Nature
- p. 195-207
Crowd-Oriented Behavior Simulation:Reinforcement Learning Framework Embedded with Emotion Model
- 29 August 2021
- Published by Wiley in Expert Systems
- Vol. 38 (8) , e12782
Recurrent knowledge tracing machine based on the knowledge state of students
Knowledge tracing (KT) aims to closely trace the knowledge level of students during their learning. KT is often implemented by intelligent tutoring systems (ITS) to predict the student performance, and schedule the individual learning plan for each student. However, most existing KT models cannot predict the knowledge forgetting well due to the lack of temporal information and some KT models for knowledge forgetting prediction are not accurate enough. To resolve these issues, this paper proposes a recurrent knowledge tracing machine (RKTM), which temporally enriches the encoding of knowledge tracing machine (KTM) and difficulty, student ability, skill, and student skill practice history (DAS3H) with the knowledge state of students. RKTM consists of two major components, including the tracing component and the predicting component. The tracing component temporally traces the knowledge state of a student, while the predicting component captures the interaction between the current learning scenario and the current knowledge state of that student and provides accurate prediction of student performance. Experiments show that the proposed RKTM well outperforms KTM, DAS3H, and some other models.
- 29 August 2021
- Published by Wiley in Expert Systems
- Vol. 38 (8) , e12782
Recurrent knowledge tracing machine based on the knowledge state of students
Knowledge tracing (KT) aims to closely trace the knowledge level of students during their learning. KT is often implemented by intelligent tutoring systems (ITS) to predict the student performance, and schedule the individual learning plan for each student. However, most existing KT models cannot predict the knowledge forgetting well due to the lack of temporal information and some KT models for knowledge forgetting prediction are not accurate enough. To resolve these issues, this paper proposes a recurrent knowledge tracing machine (RKTM), which temporally enriches the encoding of knowledge tracing machine (KTM) and difficulty, student ability, skill, and student skill practice history (DAS3H) with the knowledge state of students. RKTM consists of two major components, including the tracing component and the predicting component. The tracing component temporally traces the knowledge state of a student, while the predicting component captures the interaction between the current learning scenario and the current knowledge state of that student and provides accurate prediction of student performance. Experiments show that the proposed RKTM well outperforms KTM, DAS3H, and some other models.
- 24 January 2016
- Published by Springer Nature
- p. 67-73
Hierarchical Caching Management for Software Defined Content Network Based on Node Value
- 24 January 2016
- Published by Springer Nature
- p. 67-73
Hierarchical Caching Management for Software Defined Content Network Based on Node Value
- 16 September 2013
- Published by China Science Publishing & Media Ltd. in Journal of Computer Applications
- Vol. 33 (8) , 2158-2162
Tasks assignment optimization in Hadoop
- 16 September 2013
- Published by China Science Publishing & Media Ltd. in Journal of Computer Applications
- Vol. 33 (8) , 2158-2162
Tasks assignment optimization in Hadoop