Evaluating multimodal human-robot interaction
Open Access
- 24 August 2010
- conference paper
- Published by Association for Computing Machinery (ACM)
- Vol. 38, 1-4
Abstract
Multimodal natural behavior of humans presents a complex yet highly coordinated set of interacting processes. Providing robots with such interactive skills is a challenging and worthy goal and numerous such efforts are currently underway; evaluating the progress in this direction, however, continues to be a challenge. General methods for measuring the performance of artificially intelligent systems would be of great benefit to the research community. In this paper1 we describe an approach to evaluating human-robot multimodal natural behavior. The approach is based on a detailed scoring and spatio-temporal analysis of the structure and patterning of live behavior, at multiple temporal scales, down to the decisecond level. The approach is tested in a case study involving an early virtual robot prototype, Gandalf, which is capable of real-time verbal and non-verbal interaction with people. Our analysis includes a comparison to a comparable human-human dyadic interaction scenario. Our main objective is to develop a methodology for comparing the quality and effectiveness of human-robot interaction between a wide variety of such systems. Early results indicate that our approach holds significant promise as a future methodology for evaluating complex systems that have a natural counterpartKeywords
Funding Information
- Seventh Framework Programme (231453)
This publication has 4 references indexed in Scilit:
- Teaching Computers to Conduct Spoken Interviews: Breaking the Realtime Barrier with Learning2009
- Behavioural comparison of human–animal (dog) and human–robot (AIBO) interactionsBehavioural Processes, 2006
- Mind model for multimodal communicative creatures and humanoidsApplied Artificial Intelligence, 1999
- Hidden Real-Time Patterns in Intra- and Inter-Individual Behavior: Description and DetectionEuropean Journal of Psychological Assessment, 1996