Grounded Knowledge Graph Extraction via LLMs: An Anchor-Constrained Framework with Provenance Tracking
Open Access
Abstract
Knowledge graphs represent real-world facts as structured triplets and underpin a wide range of applications, including question answering, recommendation, and retrieval-augmented generation. Automatically extracting such triplets from unstructured text is essential for scalable knowledge base construction. Traditional extraction methods require task-specific training data and struggle to generalize across domains. Large language models (LLMs) offer an alternative through in-context learning, enabling flexible extraction without fine-tuning. However, LLMs frequently hallucinate—generating plausible triplets unsupported by the source text. The root cause is the lack of provenance: existing methods produce triplets without explicit links to their textual origins, making faithfulness unverifiable. This paper presents Anchor-Extraction-Verification-Supplement (AEVS), a framework that grounds every triplet element to the source text. AEVS operates in three stages: (1) anchor discovery identifies entities, relation phrases, and attribute values with precise positions, forming a constrained extraction vocabulary; (2) grounded extraction generates triplets linked to discovered anchors; and (3) restoration-based verification validates triplets through hierarchical matching, with a coverage-aware supplement ensuring comprehensive extraction. Experiments on WebNLG, REBEL, and Wiki-NRE demonstrate consistent improvements over both trained models and LLM-based baselines. Ablation studies confirm that anchor-based constraints are the primary mechanism for hallucination reduction. Dedicated analyses of anchor discovery quality, computational cost (2.83–4.28 LLM calls per sample), and hallucination rates (0.23–20.23% across model–dataset configurations) provide insights into the framework’s practical applicability and limitations.Keywords
Funding Information
- Ningbo Municipal Project (2024A-154-G)
- Ningbo Key Research and Development Program (2025Z046)
This publication has 20 references indexed in Scilit:
- LLMs for knowledge graph construction and reasoning: recent capabilities and future opportunitiesWorld Wide Web, 2024
- CodeKGC: Code Language Model for Generative Knowledge Graph ConstructionACM Transactions on Asian and Low-Resource Language Information Processing, 2024
- Survey of Hallucination in Natural Language GenerationACM Computing Surveys, 2023
- A Survey on Knowledge Graphs: Representation, Acquisition, and ApplicationsIEEE Transactions on Neural Networks and Learning Systems, 2021
- ReGen: Reinforcement Learning for Text and Knowledge Base Generation using Pretrained Language Models2021
- Effective Modeling of Encoder-Decoder Architecture for Joint Entity and Relation ExtractionProceedings of the AAAI Conference on Artificial Intelligence, 2020
- TPLinker: Single-stage Joint Extraction of Entities and Relations Through Token Pair Linking2020
- Double Graph Based Reasoning for Document-level Relation Extraction2020
- Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoders2020
- A Novel Cascade Binary Tagging Framework for Relational Triple Extraction2020