A Survey on Hallucination in Large Language and Foundation Models
Preprint
- 13 May 2025
- preprint
- Published by MDPI AG in Preprints.org
Abstract
Generative text models, particularly large language models (LLMs) and foundation models, have influenced numerous fields, including high-quality text generation, reasoning, and multimodal synthesis. These models have been widely applied in healthcare, legal analysis, and scientific research. However, where accuracy and reliability are critical, generative text models pose a significant risk due to hallucination, where generated outputs include incorrect factuality, fabricated, or misleading information. In this survey, we present a review of hallucination in generative AI, covering its taxonomy, detection methods, mitigation strategies, and evaluation benchmarks. We first establish a structured taxonomy, distinguishing between intrinsic vs. extrinsic hallucination and factual vs. semantic hallucination, also discussing task-specific variations in areas such as summarization, machine translation, and dialogue generation. Next, we examine state-of-the-art hallucination detection techniques, including uncertainty estimation, retrieval-augmented generation (RAG), self-consistency validation, and internal state monitoring. We further explore mitigation strategies, such as fine-tuning, reinforcement learning from human feedback (RLHF), knowledge injection, adversarial training, and contrastive learning. Additionally, we review key evaluation metrics and benchmarks, including FEVER, TruthfulQA, HALL-E, and Entity-Relationship-Based Hallucination Benchmarks (ERBench), which serve as standardized measures for assessing hallucination severity. Despite notable efforts, hallucination remains an open challenge, necessitating further improvements in real-time detection, multimodal hallucination evaluation, and trustworthiness frameworks. We show critical research gaps including the need for standardized hallucination taxonomies, scalable mitigation techniques, and human-AI hybrid verification methods. Our survey aims to serve as a foundational resource for researchers and practitioners, providing insights into current methodologies and guiding future advancements in trustworthy and explainable generative AI.Keywords
All Related Versions
This publication has 36 references indexed in Scilit:
- 🧜Siren’s Song in the AI Ocean: A Survey on Hallucination in Large Language ModelsComputational Linguistics, 2025
- ChartInsighter: An Approach for Mitigating Hallucination in Time-Series Chart Summary Generation With a Benchmark DatasetIEEE Transactions on Visualization and Computer Graphics, 2025
- Expertise or Hallucination? A Comprehensive Evaluation of ChatGPT's Aptitude in Clinical GeneticsIEEE Transactions on Big Data, 2025
- A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open QuestionsACM Transactions on Information Systems, 2025
- Hallucinations of large multimodal models: Problem and countermeasuresInformation Fusion, 2025
- Look Before You Leap: An Exploratory Study of Uncertainty Analysis for Large Language ModelsIEEE Transactions on Software Engineering, 2025
- Confidence-Enhanced Mutual Knowledge for Uncertain SegmentationIEEE Transactions on Intelligent Transportation Systems, 2023
- Survey of Hallucination in Natural Language GenerationACM Computing Surveys, 2023
- Controlling hallucinations at word level in data-to-text generationData Mining and Knowledge Discovery, 2021
- On Faithfulness and Factuality in Abstractive Summarization2020