Advances and Challenges in Multimodal Entity Linking: A Comprehensive Survey
- 30 June 2025
- journal article
- Published by World Scientific Pub Co Pte Ltd in International Journal of Software Engineering and Knowledge Engineering
- Vol. 35 (07) , 943-961
Abstract
This study offers a comprehensive examination of the recent advances and challenges in multimodal entity linking (MEL). The paper begins by outlining the background of the growth of multimodal data and the significance of knowledge bases. It provides a detailed description of the definition and architecture of the MEL task. Through an extensive analysis of existing methods, datasets, and evaluation metrics, this paper highlights the potential of MEL to enhance information retrieval accuracy and facilitate knowledge graph construction. The study indicates that, despite significant progress in the MEL field, challenges remain, including issues related to data quality, model generalization, model interpretability and multimodal fusion technologies. Finally, the paper proposes future research directions, such as the application of large language model and the development of scientific theories related to multimodal information fusion and disambiguation, thereby offering clear guidance for subsequent research.Keywords
This publication has 51 references indexed in Scilit:
- SRSCL: A strong-relatedness-sequence-based fine-grained collective entity linking method for heterogeneous information networksExpert Systems with Applications, 2023
- Knowledge-graph-enabled biomedical entity linking: a surveyWorld Wide Web, 2023
- Aligning and linking entity mentions in image, text, and knowledge baseData & Knowledge Engineering, 2022
- Explainable recommendation based on knowledge graph and multi-objective optimizationComplex & Intelligent Systems, 2021
- Richpedia: A Large-Scale, Comprehensive Multi-Modal Knowledge GraphBig Data Research, 2020
- Overview of CLEF HIPE 2020: Named Entity Recognition and Linking on Historical Newspapers2020
- Enrich cross-lingual entity links for online wikis via multi-modal semantic matchingInformation Processing & Management, 2020
- Multimodal Entity Linking for Tweets2020
- A collective entity linking algorithm with parallel computing on large-scale knowledge baseThe Journal of Supercomputing, 2019
- Entity Linking: Finding Extracted Entities in a Knowledge Base2012