Xiaotong He
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Xiaotong He has a total of 11 co-authors. Here are the top co-authors by number of shared publications:
- Huayu Li
Qingdao Institute of Software, College of Computer Science and Technology, China University of Petroleum (East China), Qingdao 266580, China
2 shared publications Chenli Shen
1 shared publication- Cuicui Wang
Qingdao Institute of Software, College of Computer Science and Technology, China University of Petroleum (East China), Qingdao, Shandong Province 266000, P. R. China
1 shared publication - Hongjuan Pei
School of Engineering Science, University of Chinese Academy of Sciences, Beijing, China
1 shared publication Huayu Li
1 shared publication- Kai Liu
Tsinghua University
1 shared publication
Latest Publications
- Open Access
- 2 August 2026
- Published by MDPI AG in Electronics
- Vol. 15 (15) , 3414
Collaborative Multimodal Entity Linking via Multi-Channel Neural Cross-Modal Interaction with Synergistic Consistency Optimization
Multimodal entity linking (MEL) grounds entity mentions in text-image contexts to entries in a structured knowledge base; however, most existing systems still decompose a multimodal document into independent mention-level decisions. This formulation overlooks a central tension of real-world MEL: the evidence needed to disambiguate an ambiguous mention is often distributed across co-occurring mentions, visual context, and cross-modal consistency, rather than being contained in the mention itself. To address this limitation, we propose Collaborative Entity Linking through Multichannel Interaction (CELMI), a four-channel framework that jointly models textual semantics, visual perception, cross-modal alignment, and inter-mention collaboration. CELMI employs dual-level textual alignment, text-guided visual gating, learned cross-modal projection, and attention-based entity graph propagation. To stabilize joint optimization, we further introduce a multi-channel consistency objective that combines per-channel contrastive losses with an overall ranking loss, reducing channel dominance and representation collapse. Among conventional non-LLM/VLM MEL models, CELMI achieves the strongest MRR and Hits@1 performance on WikiMEL, RichpediaMEL, and WikiDiverse, with Hits@1 scores of 89.03% on WikiMEL and 83.02% on RichpediaMEL; LLM/VLM systems remain stronger on WikiDiverse, positioning CELMI as a lightweight complement. Progressive stress ablation shows a 38.50 percentage-point absolute Hits@1 drop when the architecture is reduced to a single unimodal endpoint, confirming that the gains arise from synergistic channel interaction rather than isolated module effects.
- 2 August 2026
- Published by MDPI AG in Electronics
- Vol. 15 (15) , 3414
Open AccessCollaborative Multimodal Entity Linking via Multi-Channel Neural Cross-Modal Interaction with Synergistic Consistency Optimization
Multimodal entity linking (MEL) grounds entity mentions in text-image contexts to entries in a structured knowledge base; however, most existing systems still decompose a multimodal document into independent mention-level decisions. This formulation overlooks a central tension of real-world MEL: the evidence needed to disambiguate an ambiguous mention is often distributed across co-occurring mentions, visual context, and cross-modal consistency, rather than being contained in the mention itself. To address this limitation, we propose Collaborative Entity Linking through Multichannel Interaction (CELMI), a four-channel framework that jointly models textual semantics, visual perception, cross-modal alignment, and inter-mention collaboration. CELMI employs dual-level textual alignment, text-guided visual gating, learned cross-modal projection, and attention-based entity graph propagation. To stabilize joint optimization, we further introduce a multi-channel consistency objective that combines per-channel contrastive losses with an overall ranking loss, reducing channel dominance and representation collapse. Among conventional non-LLM/VLM MEL models, CELMI achieves the strongest MRR and Hits@1 performance on WikiMEL, RichpediaMEL, and WikiDiverse, with Hits@1 scores of 89.03% on WikiMEL and 83.02% on RichpediaMEL; LLM/VLM systems remain stronger on WikiDiverse, positioning CELMI as a lightweight complement. Progressive stress ablation shows a 38.50 percentage-point absolute Hits@1 drop when the architecture is reduced to a single unimodal endpoint, confirming that the gains arise from synergistic channel interaction rather than isolated module effects.
- 10 July 2026
- Published by Elsevier in Information Processing & Management
- Vol. 64 (1)
Dual-Tower Multimodal Entity Linking with Deep Interaction
- 10 July 2026
- Published by Elsevier in Information Processing & Management
- Vol. 64 (1)
Dual-Tower Multimodal Entity Linking with Deep Interaction
- 30 June 2025
- Published by World Scientific Pub Co Pte Ltd in International Journal of Software Engineering and Knowledge Engineering
- Vol. 35 (07) , 943-961
Advances and Challenges in Multimodal Entity Linking: A Comprehensive Survey
This study offers a comprehensive examination of the recent advances and challenges in multimodal entity linking (MEL). The paper begins by outlining the background of the growth of multimodal data and the significance of knowledge bases. It provides a detailed description of the definition and architecture of the MEL task. Through an extensive analysis of existing methods, datasets, and evaluation metrics, this paper highlights the potential of MEL to enhance information retrieval accuracy and facilitate knowledge graph construction. The study indicates that, despite significant progress in the MEL field, challenges remain, including issues related to data quality, model generalization, model interpretability and multimodal fusion technologies. Finally, the paper proposes future research directions, such as the application of large language model and the development of scientific theories related to multimodal information fusion and disambiguation, thereby offering clear guidance for subsequent research.
- 30 June 2025
- Published by World Scientific Pub Co Pte Ltd in International Journal of Software Engineering and Knowledge Engineering
- Vol. 35 (07) , 943-961
Advances and Challenges in Multimodal Entity Linking: A Comprehensive Survey
This study offers a comprehensive examination of the recent advances and challenges in multimodal entity linking (MEL). The paper begins by outlining the background of the growth of multimodal data and the significance of knowledge bases. It provides a detailed description of the definition and architecture of the MEL task. Through an extensive analysis of existing methods, datasets, and evaluation metrics, this paper highlights the potential of MEL to enhance information retrieval accuracy and facilitate knowledge graph construction. The study indicates that, despite significant progress in the MEL field, challenges remain, including issues related to data quality, model generalization, model interpretability and multimodal fusion technologies. Finally, the paper proposes future research directions, such as the application of large language model and the development of scientific theories related to multimodal information fusion and disambiguation, thereby offering clear guidance for subsequent research.