Survey and analysis of hallucinations in large language models: attribution to prompting strategies or model behavior
Authors:
Top Cited Papers
Open Access
- 30 September 2025
- journal article
- review article
- Published by Frontiers Media SA in Frontiers in Artificial Intelligence
- Vol. 8, 1622292
Abstract
Hallucination in Large Language Models (LLMs) refers to outputs that appear fluent and coherent but are factually incorrect, logically inconsistent, or entirely fabricated. As LLMs are increasingly deployed in education, healthcare, law, and scientific research, understanding and mitigating hallucinations has become critical. In this work, we present a comprehensive survey and empirical analysis of hallucination attribution in LLMs. Introducing a novel framework to determine whether a given hallucination stems from not optimize prompting or the model's intrinsic behavior. We evaluate state-of-the-art LLMs—including GPT-4, LLaMA 2, DeepSeek, and others—under various controlled prompting conditions, using established benchmarks (TruthfulQA, HallucinationEval) to judge factuality. Our attribution framework defines metrics for Prompt Sensitivity (PS) and Model Variability (MV), which together quantify the contribution of prompts vs. model-internal factors to hallucinations. Through extensive experiments and comparative analyses, we identify distinct patterns in hallucination occurrence, severity, and mitigation across models. Notably, structured prompt strategies such as chain-of-thought (CoT) prompting significantly reduce hallucinations in prompt-sensitive scenarios, though intrinsic model limitations persist in some cases. These findings contribute to a deeper understanding of LLM reliability and provide insights for prompt engineers, model developers, and AI practitioners. We further propose best practices and future directions to reduce hallucinations in both prompt design and model development pipelines.Keywords
This publication has 33 references indexed in Scilit:
- Benefits, Limits, and Risks of GPT-4 as an AI Chatbot for MedicineNew England Journal of Medicine, 2023
- Survey of Hallucination in Natural Language GenerationACM Computing Surveys, 2023
- TruthfulQA: Measuring How Models Mimic Human FalsehoodsarXiv, 2022
- QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarization2022
- On the Opportunities and Risks of Foundation ModelsarXiv, 2021
- Prompt Programming for Large Language Models: Beyond the Few-Shot ParadigmarXiv, 2021
- Language Models are Few-Shot LearnersarXiv, 2020
- RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models2020
- On Faithfulness and Factuality in Abstractive Summarization2020
- Bayesian Data Analysis2013