Feedback interpretation based on facial expressions in human-robot interaction
Authors:
- 1 September 2009
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 189-194
Abstract
In everyday conversation besides speech people also communicate by means of nonverbal cues. Facial expressions are one important cue, as they can provide useful information about the conversation, for instance, whether the interlocutor seems to understand or appears to be puzzled. Similarly, in human-robot interaction facial expressions also give feedback about the interaction situation. We present a Wizard of Oz user study in an object-teaching scenario where subjects showed several objects to a robot and taught the objects' names. Afterward, the robot should term the objects correctly. In a first evaluation, we let other people watch short video sequences of this study. They decided by looking at the face of the human whether the answer of the robot was correct (unproblematic situation) or incorrect (problematic situation). We conducted the experiments under specific conditions by varying the amount of temporal and visual context information and compare the results with related experiments described in the literature.Keywords
This publication has 12 references indexed in Scilit:
- Authentic facial expression analysisImage and Vision Computing, 2007
- Recognising facial expressions in video sequencesPattern Analysis and Applications, 2007
- Discovering Cues to Error Detection in Speech Recognition Output: A User-Centered ApproachJournal of Management Information Systems, 2006
- Problem detection in human–machine interactions based on facial expressions of usersSpeech Communication, 2005
- Toward a mechanistic psychology of dialogueBehavioral and Brain Sciences, 2004
- The ENCARA System for Face Detection and NormalizationLecture Notes in Computer Science, 2003
- Automatic facial expression analysis: a surveyPattern Recognition, 2003
- The dual of denial: Two uses of disconfirmations in dialogue and their prosodic correlatesSpeech Communication, 2002
- Identifying user corrections automatically in spoken dialogue systems2001
- Automatic analysis of facial expressions: the state of the artIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000