Xiaoyu Song
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Xiaoyu Song has a total of 23 co-authors. Here are the top co-authors by number of shared publications:
- Zhizhong Liu
School of Computer and Control Engineering, Yantai University, Yantai, China
5 shared publications - Jian Yu
Department of Computer Science, Auckland University of Technology, Auckland 1142, New Zealand
3 shared publications - Lingqiang Meng
Hohai University
3 shared publications - Quan Z. Sheng
Macquarie University
3 shared publications Dianhui Chu
1 shared publication- Dianhui Chu
Harbin Institute of Technology, Weihai, China
1 shared publication
Latest Publications
- Open Access
- 15 October 2026
- Published by Springer Nature in Scientific Reports
- Vol. 16 (1) , 32490
POI location-aware services package recommendation for random groups
- 15 October 2026
- Published by Springer Nature in Scientific Reports
- Vol. 16 (1) , 32490
Open AccessPOI location-aware services package recommendation for random groups
- Open Access
- 28 July 2026
- Published by MDPI AG in Information
- Vol. 17 (8) , 728
Attention Bidirectional Gated Fusion Based Multimodal Intent Recognition Under Uncertain Missing Modalities
Currently, uncertain missing modalities pose new challenges to multimodal intent recognition. To tackle this issue, this work proposes an Attention Bidirectional Gated Fusion Based Multimodal Intent Recognition model under Uncertain Missing Modalities (named ABGFMIR). Firstly, ABGFMIR extracts the features of each modality (text, audio, visual) with the LSTM network, respectively. Secondly, ABGFMIR narrows the distances between audio, visual and text modality based on Central Moment Discrepancy (CMD), and then performs multimodal feature fusion through an attention bidirectional gated fusion method. Then, corresponding attention level prompts are generated based on the uncertain missing modalities situations of the current sample. The fused multimodal features are then input into the Transformer encoder and decoder, and the prompts are injected into the keys and values of the multihead self-attention layer to guide the Transformer to focus on the missing modes and dynamically adjust the attention distribution, enhancing the robustness of ABGFMIR to different missing modes. Finally, the features produced by the Transformer are fed into the classification layer for intent recognition. Simultaneously, the pre-trained model (AGNN) that trained with the complete modality is employed in the classification layer to guide the main module of ABGFMIR. Two public benchmark datasets (MIntRec and EMOTyDA) are adopted for performance verification. Compared with the other five baseline models, on the MIntRec dataset, ABGFMIR improved accuracy by an average of 2.68 and improved F1 values by an average of 3.24. On the EMOTyDA dataset, ABGFMIR improved accuracy by an average of 2.28 and improved F1 values by an average of 3.44.
- 28 July 2026
- Published by MDPI AG in Information
- Vol. 17 (8) , 728
Open AccessAttention Bidirectional Gated Fusion Based Multimodal Intent Recognition Under Uncertain Missing Modalities
Currently, uncertain missing modalities pose new challenges to multimodal intent recognition. To tackle this issue, this work proposes an Attention Bidirectional Gated Fusion Based Multimodal Intent Recognition model under Uncertain Missing Modalities (named ABGFMIR). Firstly, ABGFMIR extracts the features of each modality (text, audio, visual) with the LSTM network, respectively. Secondly, ABGFMIR narrows the distances between audio, visual and text modality based on Central Moment Discrepancy (CMD), and then performs multimodal feature fusion through an attention bidirectional gated fusion method. Then, corresponding attention level prompts are generated based on the uncertain missing modalities situations of the current sample. The fused multimodal features are then input into the Transformer encoder and decoder, and the prompts are injected into the keys and values of the multihead self-attention layer to guide the Transformer to focus on the missing modes and dynamically adjust the attention distribution, enhancing the robustness of ABGFMIR to different missing modes. Finally, the features produced by the Transformer are fed into the classification layer for intent recognition. Simultaneously, the pre-trained model (AGNN) that trained with the complete modality is employed in the classification layer to guide the main module of ABGFMIR. Two public benchmark datasets (MIntRec and EMOTyDA) are adopted for performance verification. Compared with the other five baseline models, on the MIntRec dataset, ABGFMIR improved accuracy by an average of 2.68 and improved F1 values by an average of 3.24. On the EMOTyDA dataset, ABGFMIR improved accuracy by an average of 2.28 and improved F1 values by an average of 3.44.
- 5 February 2024
- Published by Elsevier in Information Processing & Management
- Vol. 61 (3)
POI recommendation for random groups based on cooperative graph neural networks
- 5 February 2024
- Published by Elsevier in Information Processing & Management
- Vol. 61 (3)
POI recommendation for random groups based on cooperative graph neural networks
- 15 September 2023
- Published by Elsevier in Expert Systems with Applications
- Vol. 237, 121583
POI recommendation for occasional groups Based on hybrid graph neural networks
- 15 September 2023
- Published by Elsevier in Expert Systems with Applications
- Vol. 237, 121583
POI recommendation for occasional groups Based on hybrid graph neural networks
- 27 July 2023
- Published by Springer Nature
- p. 179-193
Multimodal Intent Recognition Based on Contrastive Learning
- 27 July 2023
- Published by Springer Nature
- p. 179-193
Multimodal Intent Recognition Based on Contrastive Learning
- 27 July 2023
- Published by Springer Nature
- p. 383-398
Proactive Perception of Preferences Evolution Based on Graph Neural Networks
- 27 July 2023
- Published by Springer Nature
- p. 383-398
Proactive Perception of Preferences Evolution Based on Graph Neural Networks
- Open Access
- 25 August 2022
- Published by Frontiers Media SA in Frontiers in Neuroscience
- Vol. 16, 807085
A new classification network for diagnosing Alzheimer's disease in class-imbalance MRI datasets
Automatic identification of Alzheimer's Disease (AD) through magnetic resonance imaging (MRI) data can effectively assist to doctors diagnose and treat Alzheimer's. Current methods improve the accuracy of AD recognition, but they are insufficient to address the challenge of small interclass and large intraclass differences. Some studies attempt to embed patch-level structure in neural networks which enhance pathologic details, but the enormous size and time complexity render these methods unfavorable. Furthermore, several self-attention mechanisms fail to provide contextual information to represent discriminative regions, which limits the performance of these classifiers. In addition, the current loss function is adversely affected by outliers of class imbalance and may fall into local optimal values. Therefore, we propose a 3D Residual RepVGG Attention network (ResRepANet) stacked with several lightweight blocks to identify the MRI of brain disease, which can also trade off accuracy and flexibility. Specifically, we propose a Non-local Context Spatial Attention block (NCSA) and embed it in our proposed ResRepANet, which aggregates global contextual information in spatial features to improve semantic relevance in discriminative regions. In addition, in order to reduce the influence of outliers, we propose a Gradient Density Multiple-weighting Mechanism (GDMM) to automatically adjust the weights of each MRI image via a normalizing gradient norm. Experiments are conducted on datasets from the Alzheimer's Disease Neuroimaging Initiative (ADNI) and Australian Imaging, Biomarker and Lifestyle Flagship Study of Aging (AIBL). Experiments on both datasets show that the accuracy, sensitivity, specificity, and Area Under the Curve are consistently better than for state-of-the-art methods.
- 25 August 2022
- Published by Frontiers Media SA in Frontiers in Neuroscience
- Vol. 16, 807085
Open AccessA new classification network for diagnosing Alzheimer's disease in class-imbalance MRI datasets
Automatic identification of Alzheimer's Disease (AD) through magnetic resonance imaging (MRI) data can effectively assist to doctors diagnose and treat Alzheimer's. Current methods improve the accuracy of AD recognition, but they are insufficient to address the challenge of small interclass and large intraclass differences. Some studies attempt to embed patch-level structure in neural networks which enhance pathologic details, but the enormous size and time complexity render these methods unfavorable. Furthermore, several self-attention mechanisms fail to provide contextual information to represent discriminative regions, which limits the performance of these classifiers. In addition, the current loss function is adversely affected by outliers of class imbalance and may fall into local optimal values. Therefore, we propose a 3D Residual RepVGG Attention network (ResRepANet) stacked with several lightweight blocks to identify the MRI of brain disease, which can also trade off accuracy and flexibility. Specifically, we propose a Non-local Context Spatial Attention block (NCSA) and embed it in our proposed ResRepANet, which aggregates global contextual information in spatial features to improve semantic relevance in discriminative regions. In addition, in order to reduce the influence of outliers, we propose a Gradient Density Multiple-weighting Mechanism (GDMM) to automatically adjust the weights of each MRI image via a normalizing gradient norm. Experiments are conducted on datasets from the Alzheimer's Disease Neuroimaging Initiative (ADNI) and Australian Imaging, Biomarker and Lifestyle Flagship Study of Aging (AIBL). Experiments on both datasets show that the accuracy, sensitivity, specificity, and Area Under the Curve are consistently better than for state-of-the-art methods.