Open Access
- 12 June 2023
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 7 (2) , 1-33
Abstract
Affective touch plays an important role in human-robot interaction. However, it is challenging for robots to perceive various natural human tactile gestures accurately, and feedback human intentions properly. In this paper, we propose a data-driven affective computing system based on a biomimetic quadruped robot with large-format, high-density flexible pressure sensors, which can mimic the natural tactile interaction between humans and pet dogs. We collect 208-minute videos from 26 participates and construct a dataset of 1212 human gestures-dog actions interaction sequences. The dataset is manually annotated with an 81-tactile-gesture vocabulary and a 44-corresponding-dog-reaction vocabulary, which are constructed through literature, questionnaire, and video observation. Then, we propose a deep learning algorithm pipeline with a gesture classification algorithm based on ResNet and an action prediction algorithm based on Transformer, which achieve the classification accuracy of 99.1% and the 1-gram BLEU score of 0.87 respectively. Finally, we conduct a field study to evaluate the emotion regulation effects through tactile affective interaction, and compare it with voice interaction. The results show that our system with tactile interaction plays a significant role in alleviating user anxiety, stimulating user excitement and improving the acceptability of robotic dogs.Keywords
Funding Information
- National Natural Science Foundation Youth Fund (62202267)
This publication has 85 references indexed in Scilit:
- Context-based hand gesture recognition for the operating roomPattern Recognition Letters, 2014
- The Role of Affective Touch in Human-Robot Interaction: Human Intent and Expectations in Touching the Haptic CreatureInternational Journal of Social Robotics, 2011
- Gesture Recognition in the Haptic Creature2010
- The communication of emotion via touch.Emotion, 2009
- Touch communicates distinct emotions.Emotion, 2006
- AIBO: Toward the Era of Digital CreaturesThe International Journal of Robotics Research, 2001
- Affect Grid: A single-item scale of pleasure and arousal.Journal of Personality and Social Psychology, 1989
- Cardiovascular effects of human-pet dog interactionsJournal of Behavioral Medicine, 1988
- The Companion Animal Bonding Scale: Internal Reliability and Construct ValidityPsychological Reports, 1987
- A circumplex model of affect.Journal of Personality and Social Psychology, 1980