Longhao Fu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Longhao Fu has a total of 6 co-authors. Here are the top co-authors by number of shared publications:
- Fujiang Li
College of Electronic Information Engineering, Taiyuan University of Technology, Jinzhong 030600, China
1 shared publication - Huizhi Liang
School of Computing, Newcastle University, Newcastle NE1 7RU, UK
1 shared publication - Shufei Duan
College of Computer Science and Technology, Shanxi University of Electronic Science and Technology, Linfen 041000, China
1 shared publication - Wei Zhang
Peking University First Hospital Taiyuan Hospital, Taiyuan 030032, China
1 shared publication - Xinran Dong
College of Electronic Information Engineering, Taiyuan University of Technology, Jinzhong 030600, China
1 shared publication - Yuxin Guo
College of Electronic Information Engineering, Taiyuan University of Technology, Jinzhong 030600, China
1 shared publication
Latest Publications
- Open Access
Facial Expression Annotation and Analytics for Dysarthria Severity Classification
Dysarthria in patients post-stroke is often accompanied by central facial paralysis, which impairs facial motor control and emotional expression. Current assessments rely on acoustic modalities, overlooking facial pathological cues and their correlation with emotional expression, which hinders comprehensive disease assessment. To address this issue, we propose a multimodal severity classification framework that integrates facial and acoustic features. Firstly, a multi-level annotation algorithm based on a pre-trained model and motion amplitude was designed to overcome the problem of data scarcity. Secondly, facial topology was modeled using Delaunay triangulation, with spatial relationships captured via graph convolutional networks (GCNs), while abnormal muscle coordination is quantified using facial action units (AUs). Finally, we proposed a multimodal feature set fusion technology framework to achieve the compensation of facial visual features for acoustic modalities and the analysis of disease classification. Our experimental results using the THE-POSSD dataset demonstrate an accuracy of 92.0% and an F1 score of 91.6%, significantly outperforming single-modality baselines. This study reveals the changes in facial movements and sensitive areas of patients under different emotional states, verifies the compensatory ability of visual patterns for auditory patterns, and demonstrates the potential of this multimodal framework for objective assessment and future clinical applications in speech disorders.
Open AccessFacial Expression Annotation and Analytics for Dysarthria Severity Classification
Dysarthria in patients post-stroke is often accompanied by central facial paralysis, which impairs facial motor control and emotional expression. Current assessments rely on acoustic modalities, overlooking facial pathological cues and their correlation with emotional expression, which hinders comprehensive disease assessment. To address this issue, we propose a multimodal severity classification framework that integrates facial and acoustic features. Firstly, a multi-level annotation algorithm based on a pre-trained model and motion amplitude was designed to overcome the problem of data scarcity. Secondly, facial topology was modeled using Delaunay triangulation, with spatial relationships captured via graph convolutional networks (GCNs), while abnormal muscle coordination is quantified using facial action units (AUs). Finally, we proposed a multimodal feature set fusion technology framework to achieve the compensation of facial visual features for acoustic modalities and the analysis of disease classification. Our experimental results using the THE-POSSD dataset demonstrate an accuracy of 92.0% and an F1 score of 91.6%, significantly outperforming single-modality baselines. This study reveals the changes in facial movements and sensitive areas of patients under different emotional states, verifies the compensatory ability of visual patterns for auditory patterns, and demonstrates the potential of this multimodal framework for objective assessment and future clinical applications in speech disorders.