Shuo Wang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Shuo Wang has a total of 13 co-authors. Here are the top co-authors by number of shared publications:
- Yihao Zhi
The Chinese University of Hong Kong
2 shared publications - Binbin Huang
University of Hong Kong, Hong Kong SAR, China
1 shared publication - Chongjie Ye
FNii-Shenzhen, Shenzhen, China and SSE, CUHKSZ, Shenzhen, China
1 shared publication - Michael Xuan
UniDT Co. Ltd, Shanghai, China
1 shared publication - Pengyun Qiu
The Chinese University of Hong Kong
1 shared publication - Ruoyu Wang
ShanghaiTech University, Shanghai, China
1 shared publication
Latest Publications
- 10 September 2026
- Published by Springer Nature
- p. 589-607
AIMold: An Autonomous AI-Based Pipeline for Complex Mold Design
- 10 September 2026
- Published by Springer Nature
- p. 589-607
AIMold: An Autonomous AI-Based Pipeline for Complex Mold Design
- Open Access
- 28 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 3761-3770
HeroMaker: Human-centric Video Editing with Motion Priors
Video generation and editing, particularly human-centric video editing, has seen a surge of interest in its potential to create immersive and dynamic content. A fundamental challenge is ensuring temporal coherence and visual harmony across frames, especially in handling large-scale human motion and maintaining consistency over long sequences. The previous methods, such as zero-shot text-to-video methods with diffusion model, struggle with flickering and length limitations. In contrast, methods employing Video-2D representations grapple with accurately capturing complex structural relationships in large-scale human motion. Simultaneously, some patterns on the human body appear intermittently throughout the video, posing a knotty problem in identifying visual correspondence. To address the above problems, we present HeroMaker. This human-centric video editing framework manipulates the person's appearance within the input video and achieves consistent results across frames. Specifically, we propose to learn the motion priors, which represent the correspondences between dual canonical fields and each video frame, by leveraging the body mesh-based human motion warping and neural deformation-based margin refinement in the video reconstruction framework to ensure the semantic correctness of canonical fields. HeroMaker performs human-centric video editing by manipulating the dual canonical fields and combining them with motion priors to synthesize temporally coherent and visually plausible results. Comprehensive experiments demonstrate that our approach surpasses existing methods regarding temporal consistency, visual quality, and semantic coherence.
- 28 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 3761-3770
Open AccessHeroMaker: Human-centric Video Editing with Motion Priors
Video generation and editing, particularly human-centric video editing, has seen a surge of interest in its potential to create immersive and dynamic content. A fundamental challenge is ensuring temporal coherence and visual harmony across frames, especially in handling large-scale human motion and maintaining consistency over long sequences. The previous methods, such as zero-shot text-to-video methods with diffusion model, struggle with flickering and length limitations. In contrast, methods employing Video-2D representations grapple with accurately capturing complex structural relationships in large-scale human motion. Simultaneously, some patterns on the human body appear intermittently throughout the video, posing a knotty problem in identifying visual correspondence. To address the above problems, we present HeroMaker. This human-centric video editing framework manipulates the person's appearance within the input video and achieves consistent results across frames. Specifically, we propose to learn the motion priors, which represent the correspondences between dual canonical fields and each video frame, by leveraging the body mesh-based human motion warping and neural deformation-based margin refinement in the video reconstruction framework to ensure the semantic correctness of canonical fields. HeroMaker performs human-centric video editing by manipulating the dual canonical fields and combining them with motion priors to synthesize temporally coherent and visually plausible results. Comprehensive experiments demonstrate that our approach surpasses existing methods regarding temporal consistency, visual quality, and semantic coherence.