Jinsheng Wei
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Jinsheng Wei has a total of 37 co-authors. Here are the top co-authors by number of shared publications:
- Guanming Lu
Nanjing University of Posts and Telecommunications, Nanjing, China
9 shared publications - Jingjie Yan
Jiangsu Key Laboratory of Intelligent Information Processing and Communication Technology, College of Telecommunications and Information Engineering, Nanjing University of Posts and Telecommunications, Nanjing, China
8 shared publications - Guoying Zhao
University of Oulu, Oulu, Finland
3 shared publications - Jiawei Ding
School of Communications and Information Engineering, Nanjing University of Posts and Telecommunications, Nanjing, China
3 shared publications - Yante Li
Center for Machine Vision and Signal Analysis University of Oulu Finland
3 shared publications - Ying Liu
China Mobile Communications Group Jiangsu Co., Ltd., Nanjing Branch, Nanjing 211135, China
3 shared publications
Latest Publications
- Open Access
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 11287-11296
Point Cloud based Low-Rank Micro-Dynamic Modeling for 4D Micro-Expression Recognition
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 11287-11296
Open AccessPoint Cloud based Low-Rank Micro-Dynamic Modeling for 4D Micro-Expression Recognition
- 27 July 2026
- Published by Springer Nature in Cognitive Neurodynamics
- Vol. 20 (1) , 146
Eeg emotion recognition based on channel spatio-temporal multi-dimensional feature extraction network
- 27 July 2026
- Published by Springer Nature in Cognitive Neurodynamics
- Vol. 20 (1) , 146
Eeg emotion recognition based on channel spatio-temporal multi-dimensional feature extraction network
- 17 March 2026
- Published by Springer Nature in Multimedia Tools and Applications
- Vol. 85 (4) , 284
Cross-database facial expression recognition based on Spatio-temporal Feature Point Attention Deep Transfer Network
- 17 March 2026
- Published by Springer Nature in Multimedia Tools and Applications
- Vol. 85 (4) , 284
Cross-database facial expression recognition based on Spatio-temporal Feature Point Attention Deep Transfer Network
- Open Access
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 5873-5882
Multi-Information Hierarchical Fusion Transformer with Local Alignment and Global Correlation for Micro-Expression Recognition
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 5873-5882
Open AccessMulti-Information Hierarchical Fusion Transformer with Local Alignment and Global Correlation for Micro-Expression Recognition
- 31 January 2025
- Published by Springer Nature in Applied Intelligence
- Vol. 55 (6) , 1-18
Hypergraph denoising neural network for session-based recommendation
- 31 January 2025
- Published by Springer Nature in Applied Intelligence
- Vol. 55 (6) , 1-18
Hypergraph denoising neural network for session-based recommendation
- Open Access
- 6 January 2025
- Published by MDPI AG in Electronics
- Vol. 14 (1) , 207
Efficiently Exploiting Muti-Level User Initial Intent for Session-Based Recommendation
Session-based recommendation (SBR) aims to predict potential user interactions within an anonymous session. It utilizes learned user interests to recommend items. As research has progressed, researchers have shifted towards exploring user initial intent, which can provide practical guidance for item selection. However, a significant limitation of the current methodologies is that they often assume the first item in a session as the initial intent, neglecting the possibility of a random initial click. Additionally, these methods typically merge the initial intent with the session representation without considering dynamic changes in user interests. To address these challenges, we propose an innovative approach named Efficiently Exploiting Muti-level User Initial Intent for (EMUI) for session-based recommendation. This approach includes a multi-level initial-intent generation module (MIGM) and an interest matching module (IMM). Specifically, the MIGM is designed to extract a more comprehensive representation of user initial intent from various levels, effectively mitigating the issue of random initial clicks. Furthermore, we propose the IMM to ensure alignment between dynamic interests and user initial intent. The IMM identifies components within multi-level user initial intent that correlate with dynamic interests, thereby enhancing session representation and, ultimately, improving recommendation performance. In addition, in order to optimize the initial user intent at each level, we introduce a contrastive learning task to maximize the use of user initial intent at each level. A considerable number of experiments on three real-world datasets have shown that our EMUI has significantly enhanced the recommendation accuracy over state-of-the-art methods.
- 6 January 2025
- Published by MDPI AG in Electronics
- Vol. 14 (1) , 207
Open AccessEfficiently Exploiting Muti-Level User Initial Intent for Session-Based Recommendation
Session-based recommendation (SBR) aims to predict potential user interactions within an anonymous session. It utilizes learned user interests to recommend items. As research has progressed, researchers have shifted towards exploring user initial intent, which can provide practical guidance for item selection. However, a significant limitation of the current methodologies is that they often assume the first item in a session as the initial intent, neglecting the possibility of a random initial click. Additionally, these methods typically merge the initial intent with the session representation without considering dynamic changes in user interests. To address these challenges, we propose an innovative approach named Efficiently Exploiting Muti-level User Initial Intent for (EMUI) for session-based recommendation. This approach includes a multi-level initial-intent generation module (MIGM) and an interest matching module (IMM). Specifically, the MIGM is designed to extract a more comprehensive representation of user initial intent from various levels, effectively mitigating the issue of random initial clicks. Furthermore, we propose the IMM to ensure alignment between dynamic interests and user initial intent. The IMM identifies components within multi-level user initial intent that correlate with dynamic interests, thereby enhancing session representation and, ultimately, improving recommendation performance. In addition, in order to optimize the initial user intent at each level, we introduce a contrastive learning task to maximize the use of user initial intent at each level. A considerable number of experiments on three real-world datasets have shown that our EMUI has significantly enhanced the recommendation accuracy over state-of-the-art methods.
- 4 January 2025
- Published by Springer Nature in Multimedia Systems
- Vol. 31 (1) , 1-13
Adaptive discriminant feature learning for GNN-based session recommendation
- 4 January 2025
- Published by Springer Nature in Multimedia Systems
- Vol. 31 (1) , 1-13
Adaptive discriminant feature learning for GNN-based session recommendation
- Open Access
- 21 September 2024
- Published by MDPI AG in Electronics
- Vol. 13 (18) , 3756
Multimodal Emotion Recognition Based on Facial Expressions, Speech, and Body Gestures
The research of multimodal emotion recognition based on facial expressions, speech, and body gestures is crucial for oncoming intelligent human–computer interfaces. However, it is a very difficult task and has seldom been researched in this combination in the past years. Based on the GEMEP and Polish databases, this contribution focuses on trimodal emotion recognition from facial expressions, speech, and body gestures, including feature extraction, feature fusion, and multimodal classification of the three modalities. In particular, for feature fusion, two novel algorithms including supervised least squares multiset kernel canonical correlation analysis (SLSMKCCA) and sparse supervised least squares multiset kernel canonical correlation analysis (SSLSMKCCA) are presented, respectively, to carry out efficient facial expression, speech, and body gesture feature fusion. Different from the traditional multiset kernel canonical correlation analysis (MKCCA) algorithms, our SLSKMCCA algorithm is a supervised version and is based on the least squares form. The SSLSKMCCA algorithm is implemented by the combination of SLSMKCCA and a sparse item (L1 Norm). Moreover, two effective solving algorithms for SLSMKCCA and SSLSMKCCA are presented in addition, which use the alternated least squares and augmented Lagrangian multiplier methods, respectively. The extensive experimental results on the popular public GEMEP and Polish databases show that the recognition rate of multimodal emotion recognition is superior to bimodal and monomodal emotion recognition on average, and our presented SLSMKCCA and SSLSMKCCA fusion methods both obtain very high recognition rates, especially for the SSLSMKCCA fusion method.
- 21 September 2024
- Published by MDPI AG in Electronics
- Vol. 13 (18) , 3756
Open AccessMultimodal Emotion Recognition Based on Facial Expressions, Speech, and Body Gestures
The research of multimodal emotion recognition based on facial expressions, speech, and body gestures is crucial for oncoming intelligent human–computer interfaces. However, it is a very difficult task and has seldom been researched in this combination in the past years. Based on the GEMEP and Polish databases, this contribution focuses on trimodal emotion recognition from facial expressions, speech, and body gestures, including feature extraction, feature fusion, and multimodal classification of the three modalities. In particular, for feature fusion, two novel algorithms including supervised least squares multiset kernel canonical correlation analysis (SLSMKCCA) and sparse supervised least squares multiset kernel canonical correlation analysis (SSLSMKCCA) are presented, respectively, to carry out efficient facial expression, speech, and body gesture feature fusion. Different from the traditional multiset kernel canonical correlation analysis (MKCCA) algorithms, our SLSKMCCA algorithm is a supervised version and is based on the least squares form. The SSLSKMCCA algorithm is implemented by the combination of SLSMKCCA and a sparse item (L1 Norm). Moreover, two effective solving algorithms for SLSMKCCA and SSLSMKCCA are presented in addition, which use the alternated least squares and augmented Lagrangian multiplier methods, respectively. The extensive experimental results on the popular public GEMEP and Polish databases show that the recognition rate of multimodal emotion recognition is superior to bimodal and monomodal emotion recognition on average, and our presented SLSMKCCA and SSLSMKCCA fusion methods both obtain very high recognition rates, especially for the SSLSMKCCA fusion method.
- Open Access
- 12 April 2024
- Published by MDPI AG in Electronics
- Vol. 13 (8) , 1470
Multi-Representation Joint Dynamic Domain Adaptation Network for Cross-Database Facial Expression Recognition
In order to obtain more fine-grained information from multiple sub-feature spaces for domain adaptation, this paper proposes a novel multi-representation joint dynamic domain adaptation network (MJDDAN) and applies it to achieve cross-database facial expression recognition. The MJDDAN uses a hybrid structure to extract multi-representation features and maps the original facial expression features into multiple sub-feature spaces, aligning the expression features of the source domain and target domain in multiple sub-feature spaces from different angles to extract features more comprehensively. Moreover, the MJDDAN proposes the Joint Dynamic Maximum Mean Difference (JD-MMD) model to reduce the difference in feature distribution between different subdomains by simultaneously minimizing the maximum mean difference and local maximum mean difference in each substructure. Three databases, including eNTERFACE, FABO, and RAVDESS, are used to design a large number of cross-database transfer learning facial expression recognition experiments. The accuracy of emotion recognition experiments with eNTERFACE, FABO, and RAVDESS as target domains reach 53.64%, 43.66%, and 35.87%, respectively. Compared to the best comparison method chosen in this article, the accuracy rates were improved by 1.79%, 0.85%, and 1.02%, respectively.
- 12 April 2024
- Published by MDPI AG in Electronics
- Vol. 13 (8) , 1470
Open AccessMulti-Representation Joint Dynamic Domain Adaptation Network for Cross-Database Facial Expression Recognition
In order to obtain more fine-grained information from multiple sub-feature spaces for domain adaptation, this paper proposes a novel multi-representation joint dynamic domain adaptation network (MJDDAN) and applies it to achieve cross-database facial expression recognition. The MJDDAN uses a hybrid structure to extract multi-representation features and maps the original facial expression features into multiple sub-feature spaces, aligning the expression features of the source domain and target domain in multiple sub-feature spaces from different angles to extract features more comprehensively. Moreover, the MJDDAN proposes the Joint Dynamic Maximum Mean Difference (JD-MMD) model to reduce the difference in feature distribution between different subdomains by simultaneously minimizing the maximum mean difference and local maximum mean difference in each substructure. Three databases, including eNTERFACE, FABO, and RAVDESS, are used to design a large number of cross-database transfer learning facial expression recognition experiments. The accuracy of emotion recognition experiments with eNTERFACE, FABO, and RAVDESS as target domains reach 53.64%, 43.66%, and 35.87%, respectively. Compared to the best comparison method chosen in this article, the accuracy rates were improved by 1.79%, 0.85%, and 1.02%, respectively.
- 6 December 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. 15 (3) , 1343-1357
Geometric Graph Representation With Learnable Graph Structure and Adaptive AU Constraint for Micro-Expression Recognition
Micro-expression recognition (MER) holds significance in uncovering hidden emotions. Most works take image sequences as input and cannot effectively explore ME information because subtle ME-related motions are easily submerged in unrelated information. Instead, the facial landmark is a lowdimensional and compact modality, which achieves lower computational cost and potentially concentrates on ME-related movement features. However, the discriminability of facial landmarks for MER is unclear. Thus, this paper investigates the contribution of facial landmarks and proposes a novel framework to efficiently recognize MEs with facial landmarks. Firstly, a geometric twostream graph network is constructed to aggregate the low-order and high-order geometric movement information from facial landmarks to obtain discriminative ME representation. Secondly, a self-learning fashion is introduced to automatically model the dynamic relationship between nodes even long-distance nodes. Furthermore, an adaptive action unit loss is proposed to reasonably build a strong correlation between landmarks, facial action units and MEs. Notably, this work provides a novel idea with much higher efficiency to promote MER, only utilizing graphbased geometric features. The experimental results demonstrate that the proposed method achieves competitive performance with a significantly reduced computational cost. Furthermore, facial landmarks significantly contribute to MER and are worth further study for high-efficient ME analysis.
- 6 December 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. 15 (3) , 1343-1357
Geometric Graph Representation With Learnable Graph Structure and Adaptive AU Constraint for Micro-Expression Recognition
Micro-expression recognition (MER) holds significance in uncovering hidden emotions. Most works take image sequences as input and cannot effectively explore ME information because subtle ME-related motions are easily submerged in unrelated information. Instead, the facial landmark is a lowdimensional and compact modality, which achieves lower computational cost and potentially concentrates on ME-related movement features. However, the discriminability of facial landmarks for MER is unclear. Thus, this paper investigates the contribution of facial landmarks and proposes a novel framework to efficiently recognize MEs with facial landmarks. Firstly, a geometric twostream graph network is constructed to aggregate the low-order and high-order geometric movement information from facial landmarks to obtain discriminative ME representation. Secondly, a self-learning fashion is introduced to automatically model the dynamic relationship between nodes even long-distance nodes. Furthermore, an adaptive action unit loss is proposed to reasonably build a strong correlation between landmarks, facial action units and MEs. Notably, this work provides a novel idea with much higher efficiency to promote MER, only utilizing graphbased geometric features. The experimental results demonstrate that the proposed method achieves competitive performance with a significantly reduced computational cost. Furthermore, facial landmarks significantly contribute to MER and are worth further study for high-efficient ME analysis.