SciReviewGen: A Large-scale Dataset for Automatic Literature Review Generation
Authors:
Preprint
Abstract
Automatic literature review generation is one of the most challenging tasks in natural language processing. Although large language models have tackled literature review generation, the absence of large-scale datasets has been a stumbling block to the progress. We release SciReviewGen, consisting of over 10,000 literature reviews and 690,000 papers cited in the reviews. Based on the dataset, we evaluate recent transformer-based summarization models on the literature review generation task, including Fusion-in-Decoder extended for literature review generation. Human evaluation results show that some machine-generated summaries are comparable to human-written reviews, while revealing the challenges of automatic literature review generation such as hallucinations and a lack of detailed information. Our dataset and code are available at https://github.com/tetsu9923/SciReviewGen.Keywords
All Related Versions
This publication has 25 references indexed in Scilit:
- Survey of Hallucination in Natural Language GenerationACM Computing Surveys, 2023
- Can We Automate Scientific Reviewing?Journal of Artificial Intelligence Research, 2022
- Domain Adaptation with Pre-trained Transformers for Query Focused Abstractive Text SummarizationComputational Linguistics, 2022
- Deep learning on image denoising: An overviewNeural Networks, 2020
- Deep Learning for Image Super-Resolution: A SurveyIEEE Transactions on Pattern Analysis and Machine Intelligence, 2020
- A Survey on the New Generation of Deep Learning in Image ProcessingIEEE Access, 2019
- A Survey of Sentiment Analysis Based on Transfer LearningIEEE Access, 2019
- Brain Intelligence: Go beyond Artificial IntelligenceMobile Networks and Applications, 2017
- Growth rates of modern science: A bibliometric analysis based on the number of publications and cited referencesJournal of the Association for Information Science and Technology, 2015
- Backpropagation Applied to Handwritten Zip Code RecognitionNeural Computation, 1989