A Second-Order Meta-Analysis on the Effects of Artificial Intelligence Applications on Student Outcomes
- 13 February 2026
- journal article
- review article
- Published by SAGE Publications in Journal of Educational Computing Research
- Vol. 64 (5) , 1360-1389
Abstract
Research on AI in education has expanded rapidly, resulting in numerous first-order meta-analyses, yet these studies are limited by inconsistent findings, heterogeneous methods, variable quality, and overlapping primary studies, requiring a second-order meta-analysis to obtain a more reliable estimate of AI’s effects. This study examined the overall effect of AI applications on student outcomes, including academic achievement and higher-order thinking skills. We included first-order meta-analyses published between 2020 and 2025, covering primary studies published from 1993 to 2024. Nineteen meta-analyses obtained from electronic databases, involving a total of 58,702 participants, were analyzed. Using a random-effects model, we found a statistically significant moderate mean effect size (ES = .67, 95% CI [.55–.78]), indicating that AI technologies meaningfully contribute to student learning. The moderator analysis revealed that the moderators influencing the variability of effects of AI on student outcomes include education level, education field, and publication bias status. Effect sizes were robust across AI types and learning outcome types. Meta-regression showed that sample size and publication year did not predict effect sizes, whereas the number of primary studies did. These findings highlight the need for informed AI integration, strengthened pedagogical and institutional capacity, and evidence-based strategies to ensure meaningful improvements in student learning.Keywords
This publication has 63 references indexed in Scilit:
- Teachers and AI: Understanding the factors influencing AI integration in K-12 educationEducation and Information Technologies, 2025
- Exploring the impact of generative artificial intelligence on students’ learning outcomes: a meta-analysisEducation and Information Technologies, 2025
- The Effectiveness of AI on K-12 Students’ Mathematics Learning: A Systematic Review and Meta-AnalysisInternational Journal of Science and Mathematics Education, 2024
- Exploring the Impact of Artificial Intelligence in Teaching and Learning of Science: A Systematic Review of Empirical ResearchResearch in Science Education, 2024
- Effects of Artificial Intelligence-Powered Virtual Agents on Learning Outcomes in Computer-Based Simulations: A Meta-AnalysisEducational Psychology Review, 2024
- Exploring the Effectiveness and Moderators of Artificial Intelligence in the Classroom: A Meta-Analysis2022
- Graphical Representation of Overlap for OVErviews: GROOVE toolResearch Synthesis Methods, 2022
- Meta‐analysis and traditional systematic literature reviews—What, why, when, where, and how?Psychology & Marketing, 2022
- Introduction to Meta‐Analysis2021
- Fundamentals of Artificial Intelligence2020