One and a Half Years of ChatGPT – An Umbrella Review of Large Language Model (LLM) Perception Across Time and Research Fields
- 1 January 2026
- journal article
- review article
- Published by Hogrefe Publishing Group in Zeitschrift für Psychologie
- Vol. 234 (1-2) , 88-97
Abstract
Large language models (LLMs) like ChatGPT have emerged as transformative tools across various research fields. To illustrate the development of perceived benefits and concerns of LLMs across research fields, this umbrella review synthesized findings from 116 systematic reviews. Additionally, we employed LLM-supported data extraction and reported its promising evaluation. Applications in medicine and education dominate the literature, with accuracy and reliability as prominent challenges across disciplines and generally more benefits mentioned than concerns. Thematic analysis of most benefits within the field of psychology revealed LLMs' potentials in empathy and emotional awareness simulation, help with clinical decision-making, and supporting interventions. There were no clear temporal shifts in the perception of LLMs, except for decreasing benefits in ethics and decreasing concerns in education. To inform further research on interdisciplinary applications of LLMs, we have made our full data set consisting of nearly 3,800 extracted benefits and 3,400 concerns publicly available.Keywords
This publication has 33 references indexed in Scilit:
- Poll: Trust in AI for Accurate Health Information Is LowJAMA, 2025
- Mapping the Ethics of Generative AI: A Comprehensive Scoping ReviewMinds and Machines, 2024
- The EU's AI act: A framework for collaborative governanceInternet of Things, 2024
- Global insights and the impact of generative AI-ChatGPT on multidisciplinary: a systematic review and bibliometric analysisConnection Science, 2024
- Medical ChatGPT – A systematic Meta-ReviewmedRxiv, 2024
- Mapping the global evidence around the use of ChatGPT in higher education: A systematic scoping reviewEducation and Information Technologies, 2023
- Large language models in medicineNature Medicine, 2023
- Rapid reviews: the pros and cons of an accelerated review processEuropean Journal of Cardiovascular Nursing, 2021
- Which academic search systems are suitable for systematic reviews or meta‐analyses? Evaluating retrieval qualities of Google Scholar, PubMed, and 26 other resourcesResearch Synthesis Methods, 2019
- What makes a good systematic review and meta-analysis?British Journal of Anaesthesia, 2016