KGMedQA: An automated and comprehensive KG-based benchmark for biomedical LLM assessment
Authors:
- Qirui HaoQHQirui Hao
- Kewei ChengKCKewei Cheng
- Xinyu LiuXLXinyu Liu
- Hongliang WangHWHongliang Wang
- Junming ShaoJSJunming Shao
- Carl YangCYCarl Yang
Open Access
- 1 January 2026
- journal article
- Published by KEAI Publishing in AI Open
- Vol. 7, 152-168
Abstract
No abstract availableFunding Information
- Sichuan Provincial Science and Technology Support Program (2025YFHZ0236)
- Sichuan Provincial Science and Technology Support Program (DQ202411)
- Shenzhen Science and Technology Innovation Program
- Basic and Applied Basic Research Foundation of Guangdong Province
- Science, Technology and Innovation Commission of Shenzhen Municipality (JCYJ20230807120008016)
- Major Projects of Guangdong Education Department for Foundation Research and Applied Research (2024A1515011634)
- National Natural Science Foundation of China (62376054)
This publication has 26 references indexed in Scilit:
- A review on knowledge graphs for healthcare: Resources, applications, and promisesJournal of Biomedical Informatics, 2025
- Toward expert-level medical question answering with large language modelsNature Medicine, 2025
- Large language models for biomedicine: foundations, opportunities, challenges, and best practicesJournal of the American Medical Informatics Association, 2024
- A comprehensive evaluation of large Language models on benchmark biomedical text processing tasksComputers in Biology and Medicine, 2024
- Evaluating the ChatGPT family of models for biomedical reasoning and classificationJournal of the American Medical Informatics Association, 2024
- Unifying Large Language Models and Knowledge Graphs: A RoadmapIEEE Transactions on Knowledge and Data Engineering, 2024
- Large language models encode clinical knowledgeNature, 2023
- A Domain-Specific Next-Generation Large Language Model (LLM) or ChatGPT is Required for Biomedical Engineering and ResearchAnnals of Biomedical Engineering, 2023
- ChatGPT, Bard, and Large Language Models for Biomedical Research: Opportunities and PitfallsAnnals of Biomedical Engineering, 2023
- Biomedical discovery through the integrative biomedical knowledge hub (iBKH)iScience, 2023