A Human-in-the-Loop, LLM-Centered Architecture for Knowledge-Graph Question Answering
Preprint
Abstract
Large Language Models (LLMs) excel at language understanding but remain limited in knowledge-intensive domains due to hallucinations, outdated information, and limited explainability. Text-based retrieval-augmented generation (RAG) helps ground model outputs in external sources but struggles with multi-hop reasoning. Knowledge Graphs (KGs), in contrast, support precise, explainable querying, yet require a knowledge of query languages. This work introduces an interactive framework in which LLMs generate and explain Cypher graph queries and users iteratively refine them through natural language. Applied to real-world KGs, the framework improves accessibility to complex datasets while preserving factual accuracy and semantic rigor and provides insight into how model performance varies across domains. Our core quantitative evaluation is a 90-query benchmark on a synthetic movie KG that measures query explanation quality and fault detection across multiple LLMs, complemented by two smaller real-life query-generation experiments on a Hyena KG and the MaRDI (Mathematical Research Data Initiative) KG.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- Graph-Based Approaches and Functionalities in Retrieval-Augmented Generation: A Comprehensive SurveyACM Computing Surveys, 2026
- A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open QuestionsACM Transactions on Information Systems, 2025
- Diurnal pastoralism does not reduce juvenile recruitment nor elevate allostatic load in spotted hyenasJournal of Animal Ecology, 2022
- Why do some males choose to breed at home when most other males disperse?Science Advances, 2016
- Testing environmental and genetic effects in the presence of spatial autocorrelationEcography, 2014
- The Comprehensive R Archive NetworkWIREs Computational Statistics, 2012
- Maternal effects on offspring social status in spotted hyenasBehavioral Ecology, 2009
- Simultaneous Inference in General Parametric ModelsBiometrical Journal, 2008
- Female mate-choice drives the evolution of male-biased dispersal in a social mammalNature, 2007
- Fatal Sibling Aggression, Precocial Development, and Androgens in Neonatal Spotted HyenasScience, 1991