A Meta-Analysis and Systematic Review of the Effect of Chatbot Technology Use in Sustainable Education
Top Cited Papers
Open Access
- 6 February 2023
- journal article
- review article
- Published by MDPI AG in Sustainability
- Vol. 15 (4) , 2940
Abstract
The development of artificial intelligence in recent years has promoted the use of chatbot technology in sustainable education. Many studies examined the effect of chatbots on learning outcomes. However, scant studies summarized the effectiveness of chatbots in education. The aim of the study is to investigate the effect of chatbot-assisted learning on various components and how different moderator variables influenced the effectiveness. This study, through a meta-analysis, reviewed 32 empirical studies with 2201 participants published between 2010 and 2022. The results showed that chatbot technology exerted a medium-to-high effect on overall learning outcomes regardless of moderator variables, i.e., intervention duration, chatbot roles, and learning content. In terms of learning components, chatbots could significantly improve explicit reasoning, learning achievement, knowledge retention, and learning interest despite negative findings in critical thinking, learning engagement, and motivation. Future research could expand chatbot research by including different learning components.Keywords
Funding Information
- 2019 MOOC of Beijing Language and Culture University (MOOC201902) (important) “Introduction to Linguistics” (202010032003, SJTS202108, 22YCX017)
- “Introduction to Linguistics” of online and offline mixed courses in Beijing Language and Culture University in 2020 (202010032003, SJTS202108, 22YCX017)
- Beijing Co-construction Project Research and reform of the “Undergraduate Teaching Reform and Innovation Project” of Beijing higher education in 2020-innovative “multilingual +” excellent talent training system (202010032003, SJTS202108, 22YCX017)
- Beijing Language and Culture University (202010032003, SJTS202108, 22YCX017)
- Beijing Language and Culture University (202010032003, SJTS202108, 22YCX017)
This publication has 58 references indexed in Scilit:
- Stimulating and sustaining interest in a language course: An experimental comparison of Chatbot and Human task partnersComputers in Human Behavior, 2017
- Promoting academically productive talk with conversational agent interventions in collaborative learning settingsComputers & Education, 2015
- Measuring Effectiveness of Learning Chatbot Systems on Student's Learning Outcome and Memory RetentionAsian Journal of Applied Science and Engineering, 2014
- Meta-analyses: standardised mean differencesBMJ, 2013
- ‘Make it explicit!’: Improving collaboration through increase of script coercionJournal of Computer Assisted Learning, 2013
- Educational Technologies for Teaching Argumentation Skills2012
- Measuring inconsistency in meta-analysesBMJ, 2003
- Intrinsic and Extrinsic Motivations: Classic Definitions and New DirectionsContemporary Educational Psychology, 2000
- Interest, motivation and learning: An educational-psychological perspectiveEuropean Journal of Psychology of Education, 1999
- Toward A Hierarchical Model of Intrinsic and Extrinsic Motivation1997