Zhizhi Guo
Zhizhi Guo has a total of 19 co-authors. Here are the top co-authors by number of shared publications:
- Caigui Jiang
National Key Laboratory of Human-Machine Hybrid Augmented Intelligence, National Engineering Research Center for Visual Information and Applications, and Institute of Artificial Intelligence and Robotics, Xian Jiaotong University, Xian, China
2 shared publications Chi Zhang
Institute of Artificial Intelligence (TeleAI), China Telecom
1 shared publication- Chi Zhang
Institute of Artificial Intelligence (TeleAI), China Telecom, Beijing, China
1 shared publication - Lifang Wu
Beijing University of Technology, China
1 shared publication Quanyue Song
Xi’an Jiaotong University
1 shared publication- Quanyue Song
Xi’an Jiaotong University, Xi’an, China
1 shared publication
Latest Publications
- 18 September 2026
- Published by Springer Nature
- p. 680-697
InteractiveAvatar: Real-Time Streaming Video Generation for Consistent and Intent-Aware Avatars
- 18 September 2026
- Published by Springer Nature
- p. 680-697
InteractiveAvatar: Real-Time Streaming Video Generation for Consistent and Intent-Aware Avatars
- Open Access
- 19 March 2026
- Published by Springer Nature in Vicinagearth
- Vol. 3 (1) , 5
SyncDIT: audio-visual aligned video generation with audio synchronization feature
Audio-driven video generation has recently shown significant progress in producing realistic visual content. However, most previous studies focus primarily on speech or other narrow-band audio sources, limiting their effectiveness in scenarios involving complex auditory inputs, such as musical performances that combine transient sounds with sustained tones. To overcome these constraints, we introduce SyncDiT, a novel framework designed for synchronized audio-visual generation from complex audio signals and reference images. At its core, SyncDiT leverages an audio encoder to capture intricate acoustic characteristics within an audio clip, while an Audio Sync Cross-Attention module aligns video latents with frame-level audio synchronization features. Additionally, we construct the Musical Instrument Video (MIV) dataset, comprising diverse high-resolution instrument performance videos to support this task. Extensive experiments demonstrate that SyncDiT achieves superior audio-visual synchronization and enhanced visual quality compared to existing approaches, underscoring its effectiveness in generating lifelike videos from complex audio inputs.
- 19 March 2026
- Published by Springer Nature in Vicinagearth
- Vol. 3 (1) , 5
Open AccessSyncDIT: audio-visual aligned video generation with audio synchronization feature
Audio-driven video generation has recently shown significant progress in producing realistic visual content. However, most previous studies focus primarily on speech or other narrow-band audio sources, limiting their effectiveness in scenarios involving complex auditory inputs, such as musical performances that combine transient sounds with sustained tones. To overcome these constraints, we introduce SyncDiT, a novel framework designed for synchronized audio-visual generation from complex audio signals and reference images. At its core, SyncDiT leverages an audio encoder to capture intricate acoustic characteristics within an audio clip, while an Audio Sync Cross-Attention module aligns video latents with frame-level audio synchronization features. Additionally, we construct the Musical Instrument Video (MIV) dataset, comprising diverse high-resolution instrument performance videos to support this task. Extensive experiments demonstrate that SyncDiT achieves superior audio-visual synchronization and enhanced visual quality compared to existing approaches, underscoring its effectiveness in generating lifelike videos from complex audio inputs.
- 6 June 2024
- Published by Springer Nature in International Journal of Computer Vision
- Vol. 132 (11) , 5239-5254
Quality-Invariant Domain Generalization for Face Anti-Spoofing
- 6 June 2024
- Published by Springer Nature in International Journal of Computer Vision
- Vol. 132 (11) , 5239-5254
Quality-Invariant Domain Generalization for Face Anti-Spoofing