Lu-Yao Liu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Lu-Yao Liu has a total of 11 co-authors. Here are the top co-authors by number of shared publications:
- Jian Zhou
School of Computer Science and Technology, Dalian University of Technology, Dalian, China
2 shared publications Lin Feng
2 shared publications- Lin Feng
Dalian Minzu University
2 shared publications Wen-Zhe Liu
2 shared publications- Cheng Cheng
Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian, China
1 shared publication - Han-Qing Yang
Computer Science and Engineering, Washington University, St. Louis, USA
1 shared publication
Latest Publications
- 4 March 2023
- Published by Springer Nature in Multimedia Tools and Applications
- Vol. 82 (19) , 28917-28935
Multimodal speech emotion recognition based on multi-scale MFCCs and multi-view attention mechanism
- 4 March 2023
- Published by Springer Nature in Multimedia Tools and Applications
- Vol. 82 (19) , 28917-28935
Multimodal speech emotion recognition based on multi-scale MFCCs and multi-view attention mechanism
- 9 February 2023
- Published by Elsevier in Speech Communication
- Vol. 148, 1-8
SDTF-Net: Static and dynamic time–frequency network for Speech Emotion Recognition
- 9 February 2023
- Published by Elsevier in Speech Communication
- Vol. 148, 1-8
SDTF-Net: Static and dynamic time–frequency network for Speech Emotion Recognition
- 27 December 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 27 (3) , 1342-1353
Multi-Domain Encoding of Spatiotemporal Dynamics in EEG for Emotion Recognition
The common goal of the studies is to map any emotional states encoded from electroencephalogram (EEG) into 2-dimensional arousal-valance scores. It is still challenging due to each emotion having its specific spatial structure and dynamic dependence over the distinct time segments among EEG signals. This paper aims to model human dynamic emotional behavior by considering the location connectivity and context dependency of brain electrodes. Thus, we designed a hybrid EEG modeling method that mainly adopts the attention mechanism, combining a multi-domain spatial transformer (MST) module and a dynamic temporal transformer (DTT) module, named MSDTTs. Specifically, the MST module extracts single-domain and cross-domain features from different brain regions and fuses them into multi-domain spatial features. Meanwhile, the temporal dynamic excitation (TDE) is inserted into the multi-head convolutional transformer to form the DTT module. These two blocks work together to activate and extract the emotion-related dynamic temporal features within the DTT module. Furthermore, we place the convolutional mapping into the transformer structure to mine the static context features among the keyframes. Overall results show that high classification accuracy of 98.91%/0.14% was obtained by the $\beta$ frequency band of the DEAP dataset, and 97.52%/0.12% and 96.70%/0.26% were obtained by the $\gamma$ frequency band of SEED and SEED-IV datasets. Empirical experiments indicate that our proposed method can achieve remarkable results in comparison with state-of-the-art algorithms.
- 27 December 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 27 (3) , 1342-1353
Multi-Domain Encoding of Spatiotemporal Dynamics in EEG for Emotion Recognition
The common goal of the studies is to map any emotional states encoded from electroencephalogram (EEG) into 2-dimensional arousal-valance scores. It is still challenging due to each emotion having its specific spatial structure and dynamic dependence over the distinct time segments among EEG signals. This paper aims to model human dynamic emotional behavior by considering the location connectivity and context dependency of brain electrodes. Thus, we designed a hybrid EEG modeling method that mainly adopts the attention mechanism, combining a multi-domain spatial transformer (MST) module and a dynamic temporal transformer (DTT) module, named MSDTTs. Specifically, the MST module extracts single-domain and cross-domain features from different brain regions and fuses them into multi-domain spatial features. Meanwhile, the temporal dynamic excitation (TDE) is inserted into the multi-head convolutional transformer to form the DTT module. These two blocks work together to activate and extract the emotion-related dynamic temporal features within the DTT module. Furthermore, we place the convolutional mapping into the transformer structure to mine the static context features among the keyframes. Overall results show that high classification accuracy of 98.91%/0.14% was obtained by the $\beta$ frequency band of the DEAP dataset, and 97.52%/0.12% and 96.70%/0.26% were obtained by the $\gamma$ frequency band of SEED and SEED-IV datasets. Empirical experiments indicate that our proposed method can achieve remarkable results in comparison with state-of-the-art algorithms.
- 23 February 2022
- Published by Elsevier in Knowledge-Based Systems
- Vol. 243
ATDA: Attentional temporal dynamic activation for speech emotion recognition
- 23 February 2022
- Published by Elsevier in Knowledge-Based Systems
- Vol. 243
ATDA: Attentional temporal dynamic activation for speech emotion recognition