XHXiaotong He

Xiaotong He

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Xiaotong He has a total of 11 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Collaborative Multimodal Entity Linking via Multi-Channel Neural Cross-Modal Interaction with Synergistic Consistency Optimization

    by Huayu Li, Xiaotong He, Hongjuan Pei, Yujie Yuan, Kai Liu, Peiying Zhang

    Multimodal entity linking (MEL) grounds entity mentions in text-image contexts to entries in a structured knowledge base; however, most existing systems still decompose a multimodal document into independent mention-level decisions. This formulation overlooks a central tension of real-world MEL: the evidence needed to disambiguate an ambiguous mention is often distributed across co-occurring mentions, visual context, and cross-modal consistency, rather than being contained in the mention itself. To address this limitation, we propose Collaborative Entity Linking through Multichannel Interaction (CELMI), a four-channel framework that jointly models textual semantics, visual perception, cross-modal alignment, and inter-mention collaboration. CELMI employs dual-level textual alignment, text-guided visual gating, learned cross-modal projection, and attention-based entity graph propagation. To stabilize joint optimization, we further introduce a multi-channel consistency objective that combines per-channel contrastive losses with an overall ranking loss, reducing channel dominance and representation collapse. Among conventional non-LLM/VLM MEL models, CELMI achieves the strongest MRR and Hits@1 performance on WikiMEL, RichpediaMEL, and WikiDiverse, with Hits@1 scores of 89.03% on WikiMEL and 83.02% on RichpediaMEL; LLM/VLM systems remain stronger on WikiDiverse, positioning CELMI as a lightweight complement. Progressive stress ablation shows a 38.50 percentage-point absolute Hits@1 drop when the architecture is reduced to a single unimodal endpoint, confirming that the gains arise from synergistic channel interaction rather than isolated module effects.

  • Dual-Tower Multimodal Entity Linking with Deep Interaction

    by Huayu Li, Xiaotong He, Qi Zhang, Chenli Shen, Xiang Wang

  • Advances and Challenges in Multimodal Entity Linking: A Comprehensive Survey

    by Huayu Li, Xiaotong He, Yang Yue, Cuicui Wang

    This study offers a comprehensive examination of the recent advances and challenges in multimodal entity linking (MEL). The paper begins by outlining the background of the growth of multimodal data and the significance of knowledge bases. It provides a detailed description of the definition and architecture of the MEL task. Through an extensive analysis of existing methods, datasets, and evaluation metrics, this paper highlights the potential of MEL to enhance information retrieval accuracy and facilitate knowledge graph construction. The study indicates that, despite significant progress in the MEL field, challenges remain, including issues related to data quality, model generalization, model interpretability and multimodal fusion technologies. Finally, the paper proposes future research directions, such as the application of large language model and the development of scientific theories related to multimodal information fusion and disambiguation, thereby offering clear guidance for subsequent research.