Influence-Based Reward Modulation for Implicit Communication in Human–Robot Interaction
Open Access
- 18 April 2026
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Human-Robot Interaction
- Vol. 15 (3) , 1-33
Abstract
Communication is essential for successful interaction. In Human–Robot Interaction (HRI), implicit communication holds the potential to enhance robots’ understanding of human needs, emotions and intentions. This article introduces a method to foster implicit communication in HRI without explicitly modelling human intentions or relying on pre-existing knowledge. Leveraging Transfer Entropy, we modulate influence between agents in social interactions in scenarios involving either collaboration or competition. By integrating influence into agents’ rewards within a partially observable Markov decision process, we demonstrate that boosting influence enhances collaboration and interaction, while resisting influence promotes social independence and diminishes performance in certain scenarios. Our findings are validated through simulations and real-world experiments with human participants in social navigation and autonomous driving settings.Keywords
All Related Versions
This publication has 44 references indexed in Scilit:
- Anticipation dynamics of pedestrians based on the elliptical social force modelChaos: An Interdisciplinary Journal of Nonlinear Science, 2023
- Improved social force model considering conflict avoidanceChaos: An Interdisciplinary Journal of Nonlinear Science, 2020
- Comparison of transfer entropy methods for financial time seriesPhysica A: Statistical Mechanics and its Applications, 2017
- Extended social force model with a dynamic navigation field for bidirectional pedestrian flowFrontiers of Physics, 2017
- Learning Legible Motion from Human–Robot InteractionsInternational Journal of Social Robotics, 2017
- Transfer Entropy2016
- Elementary Principles in Statistical Mechanics2010
- Modelling contra-flow in crowd dynamics DEM simulationSafety Science, 2009
- Asimov’s “three laws of robotics” and machine metaethicsAI & SOCIETY, 2007
- A Mathematical Theory of CommunicationBell System Technical Journal, 1948