Collaboration with Generative Artificial Intelligence: An Exploratory Study Based on Learning Analytics
Authors:
Top Cited Papers
- 1 April 2024
- journal article
- research article
- Published by SAGE Publications in Journal of Educational Computing Research
- Vol. 62 (5) , 1014-1046
Abstract
The emergence of Generative Artificial Intelligence (GAI) has caused significant disruption to the traditional educational teaching ecosystem. GAI possesses remarkable capabilities in generating human-like text and boasts an extensive knowledge repository, thereby paving the way for potential collaboration with humans. However, current research on collaborating with GAI within the educational context remains insufficient and the methods are relatively limited. This study aims to utilize methods such as Lag Sequential Analysis (LSA) and Epistemic Network Analysis (ENA) to unveil the “black box” of the human-machine collaborative process. In this research, 22 students engaged in collaborative tasks with GAI to refine instructional design schemes within an authentic classroom setting. The results show that the participants significantly improved the quality of instructional design. Leveraging the improvement demonstrated in students’ instructional design performance, we categorized them into high- and low-performance groups. Through the analysis of learning behavior, it was observed that the high-performance group adhered to a structured GAI content application framework: “generate → monitor → apply → evaluate.” Moreover, they adeptly employed communication strategies emphasizing exercising cognitive agency and actively cultivating a collaborative environment. The conclusions drawn from this research may serve as a reference for a series of practical applications in human-machine collaboration and provide directions for subsequent studies.Keywords
Funding Information
- Educational Science Planning Project Fund of Jiangsu Province, China for the year 2023 (B/2023/01/193)
This publication has 19 references indexed in Scilit:
- ChatGPT-3.5 as writing assistance in students’ essaysHumanities and Social Sciences Communications, 2023
- An Empirical Study of Student Perceptions When Using ChatGPT in Academic Assignments2023
- The effect of generative artificial intelligence (AI)-based tool use on students' computational thinking skills, programming self-efficacy and motivationComputers and Education: Artificial Intelligence, 2023
- Exploring the Learnability of Program Synthesizers by Novice Programmers2022
- Identifying algorithm in program code based on structural features using CNN classification modelApplied Intelligence, 2022
- Assessing the Quality of Student-Generated Short Answer Questions Using GPT-32022
- Automatic Generation of Programming Exercises and Code Explanations Using Large Language Models2022
- The spiral model of collaborative knowledge improvement: an exploratory study of a networked collaborative classroomInternational Journal of Computer-Supported Collaborative Learning, 2021
- Sequential Analysis and Observational Methods for the Behavioral Sciences2011
- The Evolution of Research on Computer-Supported Collaborative Learning2009