Scientific production in the era of Large Language Models
Authors:
- Keigo KusumegiKKKeigo Kusumegi
- Xinyu YangXYXinyu Yang
- Paul GinspargPGPaul Ginsparg
- Mathijs de VaanMVMathijs de Vaan
- Toby StuartTSToby Stuart
- Yian YinYYYian Yin
Preprint
Abstract
Large Language Models (LLMs) are rapidly reshaping scientific research. We analyze these changes in multiple, large-scale datasets with 2.1M preprints, 28K peer review reports, and 246M online accesses to scientific documents. We find: 1) scientists adopting LLMs to draft manuscripts demonstrate a large increase in paper production, ranging from 23.7-89.3% depending on scientific field and author background, 2) LLM use has reversed the relationship between writing complexity and paper quality, leading to an influx of manuscripts that are linguistically complex but substantively underwhelming, and 3) LLM adopters access and cite more diverse prior work, including books and younger, less-cited documents. These findings highlight a stunning shift in scientific production that will likely require a change in how journals, funding agencies, and tenure committees evaluate scientific works.Keywords
All Related Versions
- Version 1, 2026-01-19, ArXiv
- Published version: Science, 390 (6779), 1240.
This publication has 28 references indexed in Scilit:
- Quantifying large language model usage in scientific papersNature Human Behaviour, 2025
- Quantifying the use and potential benefits of artificial intelligence in scientific researchNature Human Behaviour, 2024
- An empirical investigation of the impact of ChatGPT on creativityNature Human Behaviour, 2024
- Mathematical discoveries from program search with large language modelsNature, 2023
- Scaling deep learning for materials discoveryNature, 2023
- Scientific discovery in the age of artificial intelligenceNature, 2023
- ChatGPT: five priorities for researchNature, 2023
- The science of science: From the perspective of complex systemsPhysics Reports, 2017
- The Next-Generation Sequencing Revolution and Its Impact on GenomicsCell, 2013
- Seeking acceptance in an English-only research worldJournal of Second Language Writing, 2007