Exploring Shared Monitoring in Large Language Model ( LLM )‐Supported Online Collaborative Problem Solving for High‐Cohesion and Low‐Cohesion Groups
- 15 April 2026
- journal article
- research article
- Published by Wiley in Journal of Computer Assisted Learning
- Vol. 42 (3) , e70249
Abstract
Background: Recent research increasingly highlights the central role of interventions in enhancing shared monitoring during collaborative problem‐solving. However, traditional intervention approaches suffer from limitations in timeliness and adaptability. Large language model (LLM), equipped with deep semantic parsing and contextual perception, can dynamically detect latent challenges and provide targeted, timely, context‐sensitive feedback. Objectives: This study examines how LLM‐supported interventions affect group shared monitoring during dynamic CPS processes. Methods: This study designed a collaborative problem‐solving platform integrated with LLM, and 28 students from a university in China participated in CPS activities. Chi‐square tests, conditional random fields, linear mixed models and correlation analyses were adopted to examine the changes in both monitoring behaviour and equality of monitoring participation in high‐cohesion (HCGs) and low‐cohesion groups (LCGs) after LLM‐supported group metacognitive scaffolding (LLM‐GMS) intervention, as well as their effects on collaborative performance. Results and Conclusions: The results show that (1) LLM‐GMS activated more socio‐cognitive and behavioural monitoring in HCGs, whereas LCGs mainly exhibited heightened behavioural monitoring. (2) Descriptive analyses revealed divergent trends in monitoring participation equality across group types, with HCGs showing increased equality and LCGs exhibiting a decline. (3) In HCGs, socio‐emotional monitoring was positively associated with collaborative performance, whereas participation equality and behavioural monitoring exhibited negative associations with collaborative performance. In contrast, among LCGs, behavioural monitoring was positively related to performance, whereas socio‐cognitive monitoring was unexpectedly negatively associated with performance. Implications: These findings highlight that LLM‐GMS can be a valuable tool for supporting collaborative learning, but its effectiveness depends on group characteristics and its implementation approach.Keywords
Funding Information
- National Natural Science Foundation of China (62377027)
This publication has 48 references indexed in Scilit:
- Generative AI as a reflective scaffold in a UAV-based STEM project: A mixed-methods study on students’ higher-order thinking and cognitive transformationEducation and Information Technologies, 2025
- Impact of AI-agent-supported collaborative learning on the learning outcomes of University programming coursesEducation and Information Technologies, 2025
- Group Cohesion and Performance in Computer-Supported Collaborative Learning (CSCL): Using Assessment Analytics to Understand the Effects of Multi-attributional Diversity2024
- An automated group learning engagement analysis and feedback approach to promoting collaborative knowledge building, group performance, and socially shared regulation in CSCLInternational Journal of Computer-Supported Collaborative Learning, 2023
- The pivotal role of monitoring for collaborative problem solving seen in interaction, performance, and interpersonal physiologyMetacognition and Learning, 2021
- Rising to the Challenge: The Effect of Individual and Social Metacognitive Scaffolds on Students’ Expressions of Autonomy and Competence Throughout an Inquiry ProcessJournal of Science Education and Technology, 2021
- How does monitoring set the stage for adaptive regulation or maladaptive behavior in collaborative learning?Metacognition and Learning, 2020
- Facilitating socio-cognitive and socio-emotional monitoring in collaborative learning with a regulation macro script – an exploratory studyInternational Journal of Computer-Supported Collaborative Learning, 2017
- Metacognitive scaffolding in an innovative learning arrangementInstructional Science, 2010
- Assessment of metacognitive skills by means of instruction to think aloud and reflect when prompted. Does the verbalisation method affect learning?Metacognition and Learning, 2007