BiMLI: Bidirectional Link–Modality Interaction for Link Prediction in Attribute-Based Multimodal Knowledge Graphs
Open Access
- 22 September 2026
- journal article
- research article
- Published by MDPI AG in Big Data and Cognitive Computing
- Vol. 10 (10) , 323
Abstract
In attribute-based multimodal knowledge graphs, images and text serve as auxiliary entity attributes, providing semantic evidence beyond graph topology for link prediction. However, bidirectional conditional dependencies between an entity’s multimodal representations and its local links—the one-hop factual triples formed by relations and neighboring entities—remain insufficiently modeled: different local links rely on structural, visual, and textual evidence to varying degrees, and conversely, the relevance of each modality differs across local links. Existing methods have progressed from modality alignment and fusion to relation-aware, structure-aware, and adaptive selection; yet they mainly let information flow from links to modalities, while conditioning on each modality to distinguish and weight individual surrounding links remains underexplored, leaving the two selection directions disconnected. We therefore propose BiMLI, a bidirectional link–modality interaction framework. Link→Modality selects relevant structural, visual, and textual evidence conditioned on each local link, whereas Modality→Link dynamically weights an entity’s surrounding links conditioned on each modality representation. Interaction-aware feature fusion and neighborhood aggregation integrate both representations, with cross-modal contrastive regularization as an auxiliary constraint. Under a controlled comparison using ten matched random seeds, BiMLI attains mean MRR scores of 41.39% and 44.28% on DB15K and MKG-W, exceeding ROAD by 1.79 and 6.18 percentage points, respectively. Ablation and fine-grained analyses show that the two directions are functionally asymmetric yet complementary, providing evidence for the value of bidirectional conditional modeling.Keywords
All Related Versions
Funding Information
- Heilongjiang Key R&D Program (GA23A915)
- National Natural Science Foundation of China (62572143)
- Joint Fund of the National Natural Science Foundation of China (U2572213)
This publication has 34 references indexed in Scilit:
- Towards Structure-Aware Model for Multi-Modal Knowledge Graph CompletionIEEE Transactions on Multimedia, 2025
- Unveiling cross-modal consistency: Taming inter- and intra-modal noise for robust multi-modal knowledge graph completionInformation Processing & Management, 2025
- DM-MKGC: Multimodal Knowledge Graph Completion Based on Dynamic Prompt Learning and Multi-Granularity AggregationIEEE Transactions on Circuits and Systems for Video Technology, 2025
- C 2 RS: Multimodal Knowledge Graph Completion With Cross-Modal Consistency and Relation SemanticsIEEE Transactions on Artificial Intelligence, 2025
- LAFA: Multimodal Knowledge Graph Completion with Link Aware Fusion and AggregationProceedings of the AAAI Conference on Artificial Intelligence, 2024
- Give us the Facts: Enhancing Large Language Models With Knowledge Graphs for Fact-Aware Language ModelingIEEE Transactions on Knowledge and Data Engineering, 2024
- Enhanced Multi-Task Learning and Knowledge Graph-Based Recommender SystemIEEE Transactions on Knowledge and Data Engineering, 2023
- Improving recommender system via knowledge graph based exploring user preferenceApplied Intelligence, 2022
- MMKRL: A robust embedding approach for multi-modal knowledge graph representation learningApplied Intelligence, 2021
- Personalized recommendation system based on knowledge embedding and historical behaviorApplied Intelligence, 2021