Prediction of Who Will Be the Next Speaker and When Using Gaze Behavior in Multiparty Meetings
Authors:
Open Access
- 5 May 2016
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Interactive Intelligent Systems
- Vol. 6 (1) , 1-31
Abstract
In multiparty meetings, participants need to predict the end of the speaker’s utterance and who will start speaking next, as well as consider a strategy for good timing to speak next. Gaze behavior plays an important role in smooth turn-changing. This article proposes a prediction model that features three processing steps to predict (I) whether turn-changing or turn-keeping will occur, (II) who will be the next speaker in turn-changing, and (III) the timing of the start of the next speaker’s utterance. For the feature values of the model, we focused on gaze transition patterns and the timing structure of eye contact between a speaker and a listener near the end of the speaker’s utterance. Gaze transition patterns provide information about the order in which gaze behavior changes. The timing structure of eye contact is defined as who looks at whom and who looks away first, the speaker or listener, when eye contact between the speaker and a listener occurs. We collected corpus data of multiparty meetings, using the data to demonstrate relationships between gaze transition patterns and timing structure and situations (I), (II), and (III). The results of our analyses indicate that the gaze transition pattern of the speaker and listener and the timing structure of eye contact have a strong association with turn-changing, the next speaker in turn-changing, and the start time of the next utterance. On the basis of the results, we constructed prediction models using the gaze transition patterns and timing structure. The gaze transition patterns were found to be useful in predicting turn-changing, the next speaker in turn-changing, and the start time of the next utterance. Contrary to expectations, we did not find that the timing structure is useful for predicting the next speaker and the start time. This study opens up new possibilities for predicting the next speaker and the timing of the next utterance using gaze transition patterns in multiparty meetings.Keywords
This publication has 18 references indexed in Scilit:
- Data-driven models for timing feedback responses in a Map Task dialogue systemComputer Speech & Language, 2014
- Gaze and turn-taking behavior in casual conversational interactionsACM Transactions on Interactive Intelligent Systems, 2013
- Predicting Listener Backchannels: A Probabilistic Multimodal Approach2008
- A tutorial on support vector regressionStatistics and Computing, 2004
- Improvements to Platt's SMO Algorithm for SVM Classifier DesignNeural Computation, 2001
- Integration and generalization of kappas for multiple raters.Psychological Bulletin, 1980
- A simplest systematics for the organization of turn-taking for conversationLanguage, 1974
- The Analysis of Residuals in Cross-Classified Tables1973
- Some signals and rules for taking speaking turns in conversations.Journal of Personality and Social Psychology, 1972
- Some functions of gaze-direction in social interactionActa Psychologica, 1967