Fighting Fire with Fire: Infusing Artificial Intelligence into Peer Review to Sustain Quality Scholarship
- 1 September 2026
- journal article
- Published by Institute for Operations Research and the Management Sciences (INFORMS) in Management Science
- Vol. 72 (9) , 7381-7393
Abstract
Adoption of artificial intelligence (AI) by authors has accelerated production of academic articles and increased submission rates to journals, thereby straining review capacity and hurting journal outcome metrics, such as turnaround time and decision accuracy. Academic journals face an imperative to improve review quality and productivity by incorporating generative AI tools in the review workflow. As a concrete first step toward this idea, we outline a particular workflow that deploys large language models as a structured, trained, frontline reviewer. The workflow underlines that AI-produced evaluations must be transparent and contestable by authors. We emphasize the need for AI-infused peer review to be journal specific, designed for efficiency, accuracy, and accountability, within a human-in-the-loop oversight framework. We build a mathematical model of journal operations to compare outcomes under a status quo no-AI workflow and the proposed AI-infused workflow. The model captures how governed AI reconfigures human reviewer effort and illuminates conditions under which the AI-infused workflow can improve vital metrics, such as turnaround time and decision accuracy. Our essential point is that journals need to adopt a deliberate and institutionally governed approach for using AI in the review process. We recognize that identifying an “optimal” AI-infused peer review workflow or even definitively projecting the consequences of one will require substantial experimentation to calibrate and configure the workflow across multiple alternative designs. This discussion was accepted by Christoph Loch. Funding: D. Zantedeschi acknowledges support for this research from the Muma College of Business Dean’s Research Fund. Supplemental Material: The online appendix is available at https://doi.org/10.1287/mnsc.2026.00184 .Keywords
This publication has 16 references indexed in Scilit:
- Scientific production in the era of large language modelsScience, 2025
- Turning Off Your Better Judgment: Algorithmic Conformity in Artificial Intelligence-Human CollaborationJournal of Management Information Systems, 2025
- The entities enabling scientific fraud at scale are large, resilient, and growing rapidlyProceedings of the National Academy of Sciences, 2025
- Exploring Generative AI’s Impact on Research: Perspectives from Senior Scholars in Management Information SystemsACM Transactions on Management Information Systems, 2025
- Generalization bias in large language model summarization of scientific researchRoyal Society Open Science, 2025
- Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinking2025
- Machine-Assisted ProofNotices of the American Mathematical Society, 2025
- Can Large Language Models Provide Useful Feedback on Research Papers? A Large-Scale Empirical AnalysisNEJM AI, 2024
- Generative AI enhances individual creativity but reduces the collective diversity of novel contentScience Advances, 2024
- Machine Learning as a Tool for Hypothesis GenerationThe Quarterly Journal of Economics, 2024