Kiran Chhatre
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Kiran Chhatre has a total of 19 co-authors. Here are the top co-authors by number of shared publications:
- Christopher Peters
KTH Royal Institute of Technology, Stockholm, Sweden
3 shared publications - Andrii Matviienko
KTH Royal Institute of Technology, Stockholm, Sweden
1 shared publication - Brian Keegan
Technological University Dublin, Dublin, Ireland
1 shared publication - Cathy Ennis
Department of Computer Science, Maynooth University, Maynooth, Kildare, Ireland
1 shared publication Deborah Lefosse
Sapienza
1 shared publication- Emma Frid
KTH Royal Institute of Technology, Lindstedtsvägen 3, 100 44 Stockholm, Sweden
1 shared publication
Latest Publications
- Open Access
- 16 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-10
Synthetically Expressive: Evaluating gesture and voice for emotion and empathy in VR and 2D scenarios
- 16 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-10
Open AccessSynthetically Expressive: Evaluating gesture and voice for emotion and empathy in VR and 2D scenarios
- Open Access
- 6 May 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-3
Evaluating Speech and Video Models for Face-Body Congruence
- 6 May 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-3
Open AccessEvaluating Speech and Video Models for Face-Body Congruence
- Open Access
- 10 December 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-13
Emotional Speech-Driven Animation with Content-Emotion Disentanglement
To be widely adopted, 3D facial avatars must be animated easily, realistically, and directly from speech signals. While the best recent methods generate 3D animations that are synchronized with the input audio, they largely ignore the impact of emotions on facial expressions. Realistic facial animation requires lip-sync together with the natural expression of emotion. To that end, we propose EMOTE (Expressive Model Optimized for Talking with Emotion), which generates 3D talking-head avatars that maintain lip-sync from speech while enabling explicit control over the expression of emotion. To achieve this, we supervise EMOTE with decoupled losses for speech (i.e., lip-sync) and emotion. These losses are based on two key observations: (1) deformations of the face due to speech are spatially localized around the mouth and have high temporal frequency, whereas (2) facial expressions may deform the whole face and occur over longer intervals. Thus we train EMOTE with a per-frame lip-reading loss to preserve the speech-dependent content, while supervising emotion at the sequence level. Furthermore, we employ a content-emotion exchange mechanism in order to supervise different emotions on the same audio, while maintaining the lip motion synchronized with the speech. To employ deep perceptual losses without getting undesirable artifacts, we devise a motion prior in the form of a temporal VAE. Due to the absence of high-quality aligned emotional 3D face datasets with speech, EMOTE is trained with 3D pseudo-ground-truth extracted from an emotional video dataset (i.e., MEAD). Extensive qualitative and perceptual evaluations demonstrate that EMOTE produces speech-driven facial animations with better lip-sync than state-of-the-art methods trained on the same data, while offering additional, high-quality emotional control.
- 10 December 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-13
Open AccessEmotional Speech-Driven Animation with Content-Emotion Disentanglement
To be widely adopted, 3D facial avatars must be animated easily, realistically, and directly from speech signals. While the best recent methods generate 3D animations that are synchronized with the input audio, they largely ignore the impact of emotions on facial expressions. Realistic facial animation requires lip-sync together with the natural expression of emotion. To that end, we propose EMOTE (Expressive Model Optimized for Talking with Emotion), which generates 3D talking-head avatars that maintain lip-sync from speech while enabling explicit control over the expression of emotion. To achieve this, we supervise EMOTE with decoupled losses for speech (i.e., lip-sync) and emotion. These losses are based on two key observations: (1) deformations of the face due to speech are spatially localized around the mouth and have high temporal frequency, whereas (2) facial expressions may deform the whole face and occur over longer intervals. Thus we train EMOTE with a per-frame lip-reading loss to preserve the speech-dependent content, while supervising emotion at the sequence level. Furthermore, we employ a content-emotion exchange mechanism in order to supervise different emotions on the same audio, while maintaining the lip motion synchronized with the speech. To employ deep perceptual losses without getting undesirable artifacts, we devise a motion prior in the form of a temporal VAE. Due to the absence of high-quality aligned emotional 3D face datasets with speech, EMOTE is trained with 3D pseudo-ground-truth extracted from an emotional video dataset (i.e., MEAD). Extensive qualitative and perceptual evaluations demonstrate that EMOTE produces speech-driven facial animations with better lip-sync than state-of-the-art methods trained on the same data, while offering additional, high-quality emotional control.