A Comprehensive Review of Recent Advances in Multimodal Multimedia Indexing and Retrieval
Open Access
- 11 August 2025
- journal article
- review article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 143688-143712
Abstract
With the exponential growth of digital data across several domains, multimedia retrieval has emerged as a very critical research area. While much development has been witnessed in feature extraction, indexing methods, and deep learning-based retrieval models, many challenges persistently hamper the creation of efficient and scalable multimedia retrieval systems. This review systematically analyzes recent research in multimedia retrieval, highlighting key methodologies, findings, and limitations across various studies. The major gaps identified include the semantic disparity between low-level features and high-level semantics, as well as challenges of large datasets, privacy and security concerns, and the explainability of deep learning models. Besides, challenges on noisy and imbalanced data, multimodal data sources, and a lack of standardized benchmarking frameworks further limit the performance of existing systems. This paper comprehensively presents these gaps and proposes future research directions to bridge them, thereby directing the development of more robust, scalable, and user-centered multimedia retrieval systems. To overcome persistent challenges in versatility, semantic alignment, and trustworthiness, we introduce a unified framework that seamlessly integrates multimodal semantic fusion, explainable AI, privacy-preserving learning, and continual adaptation for robust and future-ready multimedia retrieval.Keywords
This publication has 64 references indexed in Scilit:
- Water Quality Management Using Hybrid Machine Learning and Data Mining Algorithms: An Indexing ApproachIEEE Access, 2022
- The Complexity of the Data Retrieval Process Using the Proposed Index ExtensionIEEE Access, 2022
- Summarization of Text and Image Captioning in Information Retrieval Using Deep Learning TechniquesIEEE Access, 2022
- Image Retrieval Using a Deep Attention-Based HashIEEE Access, 2020
- Privacy-Preserving Image Retrieval and Sharing in Social Multimedia ApplicationsIEEE Access, 2020
- MDCBIR-MF: multimedia data for content-based image retrieval by using multiple featuresMultimedia Tools and Applications, 2018
- Multimodal human–computer interaction: A surveyComputer Vision and Image Understanding, 2007
- Multimodal Video Indexing: A Review of the State-of-the-artMultimedia Tools and Applications, 2005
- Content-based image retrieval at the end of the early yearsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Query by image and video content: the QBIC systemComputer, 1995