MirrorUs: Mirroring Peers' Affective Cues to Promote Learner's Meta-Cognition in Video-based Learning
Open Access
- 28 September 2023
- journal article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Human-Computer Interaction
- Vol. 7 (CSCW2) , 1-25
Abstract
Learners' awareness of their own affective states (emotions) can improve their meta-cognition, which is a critical skill of being aware of and controlling one's cognitive, motivational, and affect, and adjusting their learning strategies and behaviors accordingly. To investigate the effect of peers' affects on learners' meta-cognition, we proposed two types of cues that aggregated peers' affects that were recognized via facial expression recognition:Locative cues (displaying the spikes of peers' emotions along a video timeline) andTemporal cues (showing the positivities of peers' emotions at different segments of a video). We conducted a between-subject experiment with 42 college students through the use of think-aloud protocols, interviews, and surveys. Our results showed that the two types of cues improved participants' meta-cognition differently. For example, interacting with theTemporal cues triggered the participants to compare their own affective responses with their peers and reflect more on why and how they had different emotions with the same video content. While the participants perceived the benefits of using AI-generated peers' cues to improve their awareness of their own learning affects, they also sought more explanations from their peers to understand the AI-generated results. Our findings not only provide novel design implications for promoting learners' meta-cognition with privacy-preserved social cues of peers' learning affects, but also suggest an expanded design framework for Explainable AI (XAI).Keywords
Funding Information
- National Science Foundation (Grant No. 2119589)
- AI Research Institutes program by the National Science Foundation and the (Award # 2229873)
This publication has 37 references indexed in Scilit:
- The Affective Computing Approach to Affect MeasurementEmotion Review, 2017
- Semi-Automated 8 Collaborative Online Training Module for Improving Communication SkillsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2017
- EEG-based automatic emotion recognition: Feature extraction, selection and classification methods2016
- The Relationship Between Self-Regulation, Motivation And Performance At Secondary School StudentsProcedia - Social and Behavioral Sciences, 2015
- Automatic Emotion Recognition Based on Body Movement Analysis: A SurveyIEEE Computer Graphics and Applications, 2014
- Co-regulation of learning in computer-supported collaborative learning environments: a discussionMetacognition and Learning, 2012
- Affect Detection from Multichannel Physiology during Learning Sessions with AutoTutor2011
- Comparing Feature Sets for Acted and Spontaneous Speech in View of Automatic Emotion Recognition2005
- Academic Engagement in Students with a Hearing Loss in Distance EducationJournal of Deaf Studies and Deaf Education, 2004
- A circumplex model of affect.Journal of Personality and Social Psychology, 1980