Fumi Honda
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Fumi Honda has a total of 7 co-authors. Here are the top co-authors by number of shared publications:
- Xianfeng Gu
Department of Computer Science, Stony Brook University, Stony Brook, USA
2 shared publications - Xiang Gao
Department of Computer Science, Stony Brook University, Stony Brook, USA
2 shared publications - Xinmu Wang
Department of Computer Science, Stony Brook University, Stony Brook, USA
2 shared publications - Heather Yu
Futurewei Technologies Inc, Santa Clara, USA
1 shared publication - Junqi Huang
Applied Mathematics and Statistics Stony Brook University Stony Brook NY USA
1 shared publication - Wei Chen
Academy for Multidisciplinary Studies Capital Normal University Beijing China
1 shared publication
Latest Publications
- Open Access
- 30 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-12
TalkFlow: Structured Latent Flow Matching for Speech Driven Holistic Motion Generation
- 30 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-12
Open AccessTalkFlow: Structured Latent Flow Matching for Speech Driven Holistic Motion Generation
- 1 July 2026
- Published by Wiley in Computer Animation and Virtual Worlds
- Vol. 37 (4) , e70173
HoloDiff: Holistic Talking Human Animation Via Latent Diffusion
Holistic talking human animation aims to synthesize coordinated facial expressions and body poses that are consistent with spoken content and human communication patterns. This task requires both realistic motion generation and accurate temporal alignment between speech and motion, which remain challenging for existing methods that model facial and bodily motion separately or operate in high‐dimensional motion spaces. We present HoloDiff, a latent diffusion framework for holistic talking human animation. Given an input speech signal, HoloDiff encodes facial and bodily dynamics into a compact and structured latent representation that preserves anatomical structure and cross‐part interactions. A speech‐conditioned diffusion process is then applied in this latent space to model long‐range temporal dynamics and generate motion sequences aligned with audio input. By performing diffusion in a structured latent space, HoloDiff reduces modeling complexity while improving temporal coherence and audio–motion alignment. Extensive experiments on the SHOW dataset demonstrate that HoloDiff produces more realistic and expressive talking human animation and achieves better multimodal correspondence between speech and motion compared to baselines.
- 1 July 2026
- Published by Wiley in Computer Animation and Virtual Worlds
- Vol. 37 (4) , e70173
HoloDiff: Holistic Talking Human Animation Via Latent Diffusion
Holistic talking human animation aims to synthesize coordinated facial expressions and body poses that are consistent with spoken content and human communication patterns. This task requires both realistic motion generation and accurate temporal alignment between speech and motion, which remain challenging for existing methods that model facial and bodily motion separately or operate in high‐dimensional motion spaces. We present HoloDiff, a latent diffusion framework for holistic talking human animation. Given an input speech signal, HoloDiff encodes facial and bodily dynamics into a compact and structured latent representation that preserves anatomical structure and cross‐part interactions. A speech‐conditioned diffusion process is then applied in this latent space to model long‐range temporal dynamics and generate motion sequences aligned with audio input. By performing diffusion in a structured latent space, HoloDiff reduces modeling complexity while improving temporal coherence and audio–motion alignment. Extensive experiments on the SHOW dataset demonstrate that HoloDiff produces more realistic and expressive talking human animation and achieves better multimodal correspondence between speech and motion compared to baselines.