Survey of Hallucination in Natural Language Generation
Preprint
Abstract
Natural Language Generation (NLG) has improved exponentially in recent years thanks to the development of deep learning technologies such as Transformer-based language models. This advancement has led to more fluent and coherent natural language generation, naturally leading to development in downstream tasks such as abstractive summarization, dialogue generation and data-to-text generation. However, it is also investigated that such generation includes hallucinated texts, which makes the performances of text generation fail to meet users' expectations in many real-world scenarios. In order to address this issue, studies in evaluation and mitigation methods of hallucinations have been presented in various tasks, but have not been reviewed in a combined manner. In this survey, we provide a broad overview of the research progress and challenges in the hallucination problem of NLG. The survey is organized into two big divisions: (i) a general overview of metrics, mitigation methods, and future directions; (ii) task-specific research progress for hallucinations in a large set of downstream tasks: abstractive summarization, dialogue generation, generative question answering, data-to-text generation, and machine translation. This survey could facilitate collaborative efforts among researchers in these tasks.Keywords
All Related Versions
This publication has 87 references indexed in Scilit:
- Data augmentation approaches in natural language processing: A surveyAI Open, 2022
- Controlling hallucinations at word level in data-to-text generationData Mining and Knowledge Discovery, 2021
- Neural Machine Translation With Explicit Phrase AlignmentIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2021
- Evaluating the state-of-the-art of End-to-End Natural Language Generation: The E2E NLG challengeComputer Speech & Language, 2020
- Few-Shot Learning via Saliency-Guided Hallucination of Samples2019
- Perception, hallucination, and illusion: reply to my criticsPhilosophical Studies, 2012
- Active skeleton for non-rigid object detection2009
- Face Hallucination: Theory and PracticeInternational Journal of Computer Vision, 2007
- Hallucinating faces2002
- Building applied natural language generation systemsNatural Language Engineering, 1997