Divesh Lala
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Divesh Lala has a total of 21 co-authors. Here are the top co-authors by number of shared publications:
- Tatsuya Kawahara
Graduate School of Informatics, Kyoto University, Kyoto, Japan
12 shared publications - Koji Inoue
Kyoto University, Kyoto, Japan
11 shared publications - Taiga Mori
Graduate School of Informatics, Kyoto University, Kyoto, Japan
5 shared publications - Keiko Ochi
Kyoto University, Kyoto, Japan
3 shared publications - Kazushi Kato
Graduate School of Informatics, Kyoto University, Kyoto, Japan
2 shared publications - Mikey Elmers
Graduate School of Informatics, Kyoto University, Kyoto, Japan
2 shared publications
Latest Publications
- Open Access
- 5 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 212-220
Multimodal Temporal Modeling for Continuous Group Emotion Recognition in Multi-party Dialogues
To realize natural behavior in dialogue agents in multi-party dialogue scenarios, it is important to understand group emotion such as valence and arousal as a whole. Most prior work addressed this task at the utterance level or using a coarse-grained time window, which is not sufficient to capture emotional dynamics. In this study, we formulate continuous recognition of the Group Emotion at a one-second resolution. Moreover, we also introduce the Mixed state, which captures the emotional divergence among participants in the group. We constructed a dataset with frame-level soft labels based on the TEIDAN corpus and propose a multimodal temporal framework that integrates audio and video information using a sliding-window context. Experimental results demonstrate that the temporal Transformer outperforms simple baselines and shows stronger temporal agreement with the ground-truth labels than the LLM-based model. The effect of context length is limited, whereas audio-visual input outperforms either unimodal input on the continuous-label metrics. Additionally, our analysis shows larger Group Emotion recognition errors in intervals with high Mixed values, exposing emotional divergence as a key challenge for group emotion recognition.
- 5 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 212-220
Open AccessMultimodal Temporal Modeling for Continuous Group Emotion Recognition in Multi-party Dialogues
To realize natural behavior in dialogue agents in multi-party dialogue scenarios, it is important to understand group emotion such as valence and arousal as a whole. Most prior work addressed this task at the utterance level or using a coarse-grained time window, which is not sufficient to capture emotional dynamics. In this study, we formulate continuous recognition of the Group Emotion at a one-second resolution. Moreover, we also introduce the Mixed state, which captures the emotional divergence among participants in the group. We constructed a dataset with frame-level soft labels based on the TEIDAN corpus and propose a multimodal temporal framework that integrates audio and video information using a sliding-window context. Experimental results demonstrate that the temporal Transformer outperforms simple baselines and shows stronger temporal agreement with the ground-truth labels than the LLM-based model. The effect of context length is limited, whereas audio-visual input outperforms either unimodal input on the continuous-label metrics. Additionally, our analysis shows larger Group Emotion recognition errors in intervals with high Mixed values, exposing emotional divergence as a key challenge for group emotion recognition.
- Open Access
- 5 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 397-404
TEIDAN: A Multilingual Multiparty Dialogue Corpus
- 5 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 397-404
Open AccessTEIDAN: A Multilingual Multiparty Dialogue Corpus
- Open Access
- 4 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 350-358
Real-time Generation of Listener Nodding via Prediction of Kinematic Parameters for Avatar Dialogue Systems
- 4 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 350-358
Open AccessReal-time Generation of Listener Nodding via Prediction of Kinematic Parameters for Avatar Dialogue Systems
- Open Access
- 4 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 1486-1488
CCMI 2026: The 2nd International Workshop on Cross-Cultural Multimodal Interaction
- 4 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 1486-1488
Open AccessCCMI 2026: The 2nd International Workshop on Cross-Cultural Multimodal Interaction
- Open Access
- 4 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 1254-1262
Real-time Multimodal Addressee Detection in Multi-party Dialogue
- 4 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 1254-1262
Open AccessReal-time Multimodal Addressee Detection in Multi-party Dialogue
- Open Access
- 12 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 808-810
CCMI 2025: Cross-Cultural Multimodal Interaction
- 12 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 808-810
Open AccessCCMI 2025: Cross-Cultural Multimodal Interaction
- Open Access
- 12 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 209-217
Real-time Generation of Various Types of Nodding for Avatar Attentive Listening System
- 12 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 209-217
Open AccessReal-time Generation of Various Types of Nodding for Avatar Attentive Listening System
- Open Access
- 19 May 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. 17 (2) , 1427-1437
Robot-Mediated Multi-Party Conversation Aimed at Affect Improvement for Psychiatric Patients
This paper describes a multi-party attentive listening system that interacts with two persons to familiarize each other through conversation. We are mainly targeting social implementation in hospitals to contribute to the rehabilitation of people with psychiatric disorders to promote affect improvement in terms of pleasure and arousal. We conducted an experiment in a psychiatric outpatient-daycare program. Twenty daycare attendees participated in a three-party conversation session between a pair of two humans and a humanoid robot. One of the paired participants talked about his/her favorite topic and was attentively listened to by the other and the robot. In a subsequent session, the human pairs switched each other's roles. The subjective evaluations showed that both the pleasure and arousal of the participants were significantly improved after the conversation. The participants rated the impression of the robot as easier to talk with than strangers. They also rated that they could understand and feel familiar with significantly more their human talk partner after the conversational session. The multiple linear regression analysis showed that participants became more pleasant and verbal when stimulated by backchannels and questions from both the human listener and the robot. It suggests that those who expressed themself using more words received positive impressions.
- 19 May 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. 17 (2) , 1427-1437
Open AccessRobot-Mediated Multi-Party Conversation Aimed at Affect Improvement for Psychiatric Patients
This paper describes a multi-party attentive listening system that interacts with two persons to familiarize each other through conversation. We are mainly targeting social implementation in hospitals to contribute to the rehabilitation of people with psychiatric disorders to promote affect improvement in terms of pleasure and arousal. We conducted an experiment in a psychiatric outpatient-daycare program. Twenty daycare attendees participated in a three-party conversation session between a pair of two humans and a humanoid robot. One of the paired participants talked about his/her favorite topic and was attentively listened to by the other and the robot. In a subsequent session, the human pairs switched each other's roles. The subjective evaluations showed that both the pleasure and arousal of the participants were significantly improved after the conversation. The participants rated the impression of the robot as easier to talk with than strangers. They also rated that they could understand and feel familiar with significantly more their human talk partner after the conversational session. The multiple linear regression analysis showed that participants became more pleasant and verbal when stimulated by backchannels and questions from both the human listener and the robot. It suggests that those who expressed themself using more words received positive impressions.
- Open Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-8
Does the Appearance of Autonomous Conversational Robots Affect User Spoken Behaviors in Real-World Conference Interactions?
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-8
Open AccessDoes the Appearance of Autonomous Conversational Robots Affect User Spoken Behaviors in Real-World Conference Interactions?
- 20 October 2023
- Published by Taylor & Francis in Advanced Robotics
- Vol. 37 (21) , 1406-1418
Dual variational generative model and auxiliary retrieval for empathetic response generation by conversational robot
- 20 October 2023
- Published by Taylor & Francis in Advanced Robotics
- Vol. 37 (21) , 1406-1418
Dual variational generative model and auxiliary retrieval for empathetic response generation by conversational robot