Inferring Operator Emotions from a Motion-Controlled Robotic Arm
Preprint
Abstract
A remote robot operator's affective state can significantly impact the resulting robot's motions leading to unexpected consequences, even when the user follows protocol and performs permitted tasks. The recognition of a user operator's affective states in remote robot control scenarios is, however, underexplored. Current emotion recognition methods rely on reading the user's vital signs or body language, but the devices and user participation these measures require would add limitations to remote robot control. We demonstrate that the functional movements of a remote-controlled robotic avatar, which was not designed for emotional expression, can be used to infer the emotional state of the human operator via a machine-learning system. Specifically, our system achieved 83.3$\%$ accuracy in recognizing the user's emotional state expressed by robot movements, as a result of their hand motions. We discuss the implications of this system on prominent current and future remote robot operation and affective robotic contexts.Keywords
All Related Versions
This publication has 41 references indexed in Scilit:
- A systematic review on affective computing: emotion models, databases, and recent advancesInformation Fusion, 2022
- The Zoomorphic Miro Robot’s Affective Expression Design and Perceived AppearanceInternational Journal of Social Robotics, 2022
- Emotion Recognition From Body MovementIEEE Access, 2019
- Robotics in Dental ImplantologyOral and Maxillofacial Surgery Clinics of North America, 2019
- Affective computing in virtual reality: emotion recognition from brain and heartbeat dynamics using wearable sensorsScientific Reports, 2018
- Robotic-Arm Assisted Total Knee Arthroplasty Demonstrated Greater Accuracy and Precision to Plan Compared with Manual TechniquesThe Journal of Knee Surgery, 2018
- Random forest-based approach for physiological functional variable selection for driver’s stress level classificationStatistical Methods & Applications, 2018
- Modelling multimodal expression of emotion in a virtual agentPhilosophical Transactions of the Royal Society B: Biological Sciences, 2009
- Emotion recognition in human-computer interactionIEEE Signal Processing Magazine, 2001
- An argument for basic emotionsCognition and Emotion, 1992