A Machine Learning Approach to Leverage Individual Keyboard and Mouse Interaction Behavior From Multiple Users in Real-World Learning Scenarios
Open Access
- 20 July 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 6, 39154-39179
Abstract
There is strong evidence that emotions influence the learning process. For this reason, we explore the relevance of individual and general mouse and keyboard interaction patterns in real-world settings while learners perform free text tasks. To this end, we have modeled users' mouse movements and keystroke dynamics with data mining techniques, building on previous related research and extending it in terms of some critical modeling issues that may have an impact on detection results. Inspired by practice in affective computing where physiological sensors are used, we argue for the creation of an interaction baseline model, as a reference point in the way how learners interact with the keyboard and mouse. To make the proposed affective model feasible, we have adopted a simplified 2-D self-labeling approach for labeling the users' affective state. Our approach to affect detection improves results when there is a small amount of data instances available and does not require additional affect-oriented tasks from the learners. Specifically, learners are only asked to self-reflect their emotional state after finishing the tasks and immediately selecting two values in the affect scale. The approach we have followed aims to distill two types of interaction patterns: 1) within-subject patterns (from a single participant) and 2) between-subject patterns (across all participants). Doing this, we aim to combine both the approaches as modeling factors, thus taking advantage of individual and general interaction patterns to predict affect.Keywords
Funding Information
- Secretaría de Estado de Investigación, Desarrollo e Innovación (BES-2012-054522, EEBB-I-16-11857, TIN2011-29221-C03-01 (MAMIPEC), TIN2014-59641-C2-2-P (BIG-AFF))
This publication has 54 references indexed in Scilit:
- Better to be frustrated than bored: The incidence, persistence, and impact of learners’ cognitive–affective states during interactions with three different computer-based learning environmentsInternational Journal of Human-Computer Studies, 2010
- KNIME - the Konstanz information minerACM SIGKDD Explorations Newsletter, 2009
- Students, tasks and emotions: Identifying the contribution of emotions to students' reading of popular culture and popular science textsLearning and Instruction, 2005
- Keystroke analysis of free textACM Transactions on Information and System Security, 2005
- Affect and learning: An exploratory look into the role of affect in learning with AutoTutorJournal of Educational Media, 2004
- Statistical pattern recognition: a reviewIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Classification by pairwise couplingThe Annals of Statistics, 1998
- Measuring emotion: The self-assessment manikin and the semantic differentialJournal of Behavior Therapy and Experimental Psychiatry, 1994
- Differences in Shame and Pride as a Function of Children's Gender and Task DifficultyChild Development, 1992
- A circumplex model of affect.Journal of Personality and Social Psychology, 1980