Integrating LLMs and Knowledge Graphs for Medical AI: Advances, Challenges, and Future Directions
- 16 October 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 30 (5) , 3833-3848
Abstract
This review synthesizes how integrating large language models (LLMs) with knowledge graphs (KGs) advances medical AI across methods, applications, and evaluation. While LLMs excel at natural language understanding and contextual reasoning, KGs provide structured factual knowledge, ensuring reliability in critical domains like healthcare AI. This review explores recent advances, emphasizing how LLM-KG synergy enhances knowledge extraction, clinical decision support, and explainability in medical applications. We analyze integration methodologies across three key frameworks: (a) KG-enhanced LLMs, where KGs refine reasoning during pre-training and inference; (b) LLM-augmented KGs, where LLMs improve KG construction, reasoning, and query resolution; and (c) Synergistic LLM-KG systems, which enable bidirectional knowledge exchange for more robust AI-driven decision-making. While these models offer substantial improvements in medical diagnostics, personalized treatment, and automated knowledge discovery, key challenges remain. Issues such as data heterogeneity, reasoning transparency, computational scalability, and ethical considerations surrounding patient data must be addressed to enable real-world clinical adoption. This review outlines future directions, including cross-domain knowledge integration, neurosymbolic AI frameworks, causal reasoning for explainable predictions, and multi-agent ensemble models for adaptive decision-making. We emphasize that scalability, real-time KG updates, and privacy-preserving mechanisms are vital for responsible, high-impact AI deployment in medicine.Keywords
This publication has 86 references indexed in Scilit:
- Guest Editorial: Special issue on “Neuro-Symbolic Intelligence: large Language Model enabled Knowledge Engineering”World Wide Web, 2025
- NSSC: a neuro-symbolic AI system for enhancing accuracy of named entity recognition and linking from oncologic clinical notesMedical & Biological Engineering & Computing, 2024
- Generative AI Research: ChatGPT Research in the Asia–Pacific Region—Demographic and Thematic Trends2024
- DrugFormer: Graph‐Enhanced Language Model to Predict Drug SensitivityAdvanced Science, 2024
- MedSyn: LLM-Based Synthetic Medical Text Generation Framework2024
- LLMs for knowledge graph construction and reasoning: recent capabilities and future opportunitiesWorld Wide Web, 2024
- KnowledgeNavigator: leveraging large language models for enhanced reasoning over knowledge graphComplex & Intelligent Systems, 2024
- An analysis of large language models: their impact and potential applicationsKnowledge and Information Systems, 2024
- A medical question answering system using large language models and knowledge graphsInternational Journal of Intelligent Systems, 2022
- RGCN: Recurrent Graph Convolutional Networks for Target-Dependent Sentiment Analysis2019