Utilizing Multimodal Data Through fsQCA to Explain Engagement in Adaptive Learning
- 31 August 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Learning Technologies
- Vol. 13 (4) , 689-703
Abstract
Investigating and explaining the patterns of learners' engagement in adaptive learning conditions is a core issue towards improving the quality of personalized learning services. This study collects learner data from multiple sources during an adaptive learning activity, and employs a fuzzy set qualitative comparative analysis (fsQCA) approach to shed light to learners' engagement patterns, with respect to their learning performance. Specifically, this study measures and codes learners' engagement by fusing and compiling clickstreams (e.g., response time), physiological data (e.g., eye-tracking, EEG, electrodermal activity) and survey data (e.g., goal-orientation) to determine what configurations of those data explain when learners can attain high or medium/low learning performance. For the evaluation of the approach, an empirical study with 32 undergraduates was conducted. The analysis revealed six configurations that explain learners' high performance and three that explain learners' medium/low performance, driven by engagement measures coming from the multimodal data. Since fsQCA explains the outcome of interest itself, rather than its variance, these findings advance our understanding on the combined effect of the multiple indicators of engagement on learners' performance. Limitations and potential implications of the findings are also discussed.Keywords
This publication has 82 references indexed in Scilit:
- Moving beyond multiple regression analysis to algorithms: Calling for adoption of a paradigm shift from symmetric to asymmetric thinking in data analysis and crafting theoryJournal of Business Research, 2013
- Situational interest, computer self‐efficacy and self‐regulation: Their impact on student engagement in distance educationBritish Journal of Educational Technology, 2011
- Using Electroencephalography to Measure Cognitive LoadEducational Psychology Review, 2010
- Cue strength as a moderator of the testing effect: The benefits of elaborative retrieval.Journal of Experimental Psychology: Learning, Memory, and Cognition, 2009
- Promoting Learning and Achievement Through Self-AssessmentTheory Into Practice, 2009
- The Contributions and Prospects of Goal Orientation TheoryEducational Psychology Review, 2006
- Formative assessment and self‐regulated learning: a model and seven principles of good feedback practiceStudies in Higher Education, 2006
- Test-Enhanced LearningPsychological Science, 2006
- School Engagement: Potential of the Concept, State of the EvidenceReview of Educational Research, 2004
- Feedback and Self-Regulated Learning: A Theoretical SynthesisReview of Educational Research, 1995