Detecting Learner Engagement in MOOCs using Automatic Facial Expression Recognition
Authors:
- 1 April 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 447-456
Abstract
Drop out rates in Massive Open Online Courses (MOOCs) are very high. Although there are many external factors, such as users not having enough time or not intending to complete the course, there are some aspects that instructors can control to optimally engage their students. To do this, they need to know how students engage throughout their video lecture. This paper explores the use of webcams to record students’ facial expressions whilst they watched educational video material to analyse their Learner Engagement levels. Convolutional neural networks (CNNs) were trained to detect facial action units, which were mapped onto two psychological measurements, valence (emotional state) and arousal (attentiveness), using support vector regressions. These valence and arousal values were combined in a novel manner resulting in Learner Engagement levels. Moreover, a new approach was used to combine CNNs with geometric feature-based techniques to improve the performance of the models. Two experiments were conducted and found that 9 out of 10 CNN models achieved 95% accuracy on average across the majority of the subjects, whilst the Learner Engagement detector was able to identify facial expressions that translated to Learner Engagement levels successfully. These results suggest that there is promise in this approach, in that feedback on students’ Learner Engagement can be provided back to the instructor. Additional research should be undertaken to further prove these results and overcome some limitations that were faced.Keywords
This publication has 40 references indexed in Scilit:
- Presentation and validation of the Radboud Faces DatabaseCognition and Emotion, 2010
- Multi-PIEImage and Vision Computing, 2010
- Affect-aware tutors: recognising and responding to student affectInternational Journal of Learning Technology, 2009
- We Feel, Therefore We Learn: The Relevance of Affective and Social Neuroscience to EducationMind, Brain, and Education, 2007
- Automatic Recognition of Facial Actions in Spontaneous ExpressionsJournal of Multimedia, 2006
- Affective Learning — A ManifestoBT Technology Journal, 2004
- Recognizing action units for facial expression analysisIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001
- Expert system for automatic analysis of facial expressionsImage and Vision Computing, 2000
- AutoTutor: A simulation of a human tutorCognitive Systems Research, 1999
- A circumplex model of affect.Journal of Personality and Social Psychology, 1980