Hri-Free: Cognitive Robotic Simulation for Evaluating Embodied Social Attention Models
Authors:
- 19 May 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 11249-11255
Abstract
Scaling social robot studies is constrained due to the need for human interaction, making large participant recruitment impractical. Robotics simulators help mitigate this limitation but generally lack the realism to accurately simulate social cues. We introduce a cognitive robotic simulation scheme to evaluate social attention models in physical environments. By projecting ground-truth priority maps to a simulated environment, we can directly compare predicted maps using common saliency metrics. Using the iCub robot, we assess a dynamic scanpath model that predicts attention targets, simulating human scanpaths. Evaluations with the FindWho and MVVA datasets show strong correlations between robotcaptured metrics and direct-streamed video metrics. Our results indicate robustness of the social attention model to noise and real-world conditions, suggesting its practical usability for predicting personalized scanpaths in real settings. This approach reduces the need for extensive human-robot interaction studies in the early stages of study design, enabling the scalability and reproducibility of social robot evaluations.Keywords
This publication has 22 references indexed in Scilit:
- Enhancing social robot's direct gaze expression through vestibulo-ocular movementsAdvanced Robotics, 2024
- A Trained Humanoid Robot can Perform Human-Like Crossmodal Social Attention and Conflict ResolutionInternational Journal of Social Robotics, 2023
- A survey on human-aware robot navigationRobotics and Autonomous Systems, 2021
- Learning to Predict Salient Faces: A Novel Visual-Audio Saliency Model2020
- Focusing on the face or getting distracted by social signals? The effect of distracting gestures on attentional focus in natural interactionPsychological Research, 2020
- Gaze360: Physically Unconstrained Gaze Estimation in the Wild2019
- A Neurorobotic Experiment for Crossmodal Conflict Resolution in Complex Environments2018
- Social Saliency2016
- The iCub humanoid robot: An open-systems platform for research in cognitive developmentNeural Networks, 2010
- Eye Movements2007