Ronghui Li
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Ronghui Li has a total of 49 co-authors. Here are the top co-authors by number of shared publications:
- Xiu Li
Tsinghua University
6 shared publications - Yue Ma
Hong Kong University of Science and Technology, HongKong, Hong Kong
2 shared publications - Yukang Lin
Tsinghua University, Shenzhen, China
2 shared publications - Zunnan Xu
Tsinghua University, Shenzhen, China
2 shared publications - Changsheng Xu
Institute of Automation, Chinese Academy of Sciences, Beijing, China, University of Chinese Academy of Sciences, Beijing, China, and Peng Cheng Laboratory, Shenzhen, China
1 shared publication - Chao Xu
Ant Group, Hangzhou, China
1 shared publication
Latest Publications
- Open Access
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 3299-3308
Camera Operator: Object-Grounded Camera Trajectory Generation from Text and 3D Bounding Box Sequences
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 3299-3308
Open AccessCamera Operator: Object-Grounded Camera Trajectory Generation from Text and 3D Bounding Box Sequences
- Open Access
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 16075-16084
Who is a Better Puppeteer: Subjective and Objective Quality Assessment for Generative 3D Animated Human
Although recent advances in AI-based Text-to-Motion (T2M) algorithms have enabled text-driven 3D Animated Human (3DAH), often referred to as "Puppeteers" for their ability to streamline 3D animation design, the quality of the generated motion remains a critical concern. More importantly, the T2M field continues to lack reliable and objective evaluation metrics, which substantially hinders the advancement of puppeteers and negatively impacts user experience. To address this gap, we introduce the first large-scale quality assessment dataset for generative 3DAHs, termed AHQA-3D, which comprises 1,200 3DAHs sequences generated by 6 representative puppeteers. Through carefully designed subjective experiments involving recruited participants, we obtain human quality ratings for each 3DAH. The results highlight the impact of different factors on animation quality. We further propose ViSCA, an objective quality assessment agent based on Qwen2.5-VL. ViSCA supports end-to-end quality evaluation across four dimensions: 3D motion fidelity, 2D human body representation, visual quality, and semantic consistency. Experimental results demonstrate that ViSCA outperforms existing evaluation methods and exhibits stronger alignment with human perception.
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 16075-16084
Open AccessWho is a Better Puppeteer: Subjective and Objective Quality Assessment for Generative 3D Animated Human
Although recent advances in AI-based Text-to-Motion (T2M) algorithms have enabled text-driven 3D Animated Human (3DAH), often referred to as "Puppeteers" for their ability to streamline 3D animation design, the quality of the generated motion remains a critical concern. More importantly, the T2M field continues to lack reliable and objective evaluation metrics, which substantially hinders the advancement of puppeteers and negatively impacts user experience. To address this gap, we introduce the first large-scale quality assessment dataset for generative 3DAHs, termed AHQA-3D, which comprises 1,200 3DAHs sequences generated by 6 representative puppeteers. Through carefully designed subjective experiments involving recruited participants, we obtain human quality ratings for each 3DAH. The results highlight the impact of different factors on animation quality. We further propose ViSCA, an objective quality assessment agent based on Qwen2.5-VL. ViSCA supports end-to-end quality evaluation across four dimensions: 3D motion fidelity, 2D human body representation, visual quality, and semantic consistency. Experimental results demonstrate that ViSCA outperforms existing evaluation methods and exhibits stronger alignment with human perception.
- Open Access
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 10305-10314
InterAnimate: Taming Region-Aware Diffusion Model for Realistic Human Interaction Animation
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 10305-10314
Open AccessInterAnimate: Taming Region-Aware Diffusion Model for Realistic Human Interaction Animation
- Open Access
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 9743-9752
Separate to Collaborate: Dual-Stream Diffusion Model for Coordinated Piano Hand Motion Synthesis
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 9743-9752
Open AccessSeparate to Collaborate: Dual-Stream Diffusion Model for Coordinated Piano Hand Motion Synthesis
- Open Access
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 1404-1413
A Motion is Worth a Hybrid Sentence: Taming Language Model for Unified Motion Generation by Fine-grained Planning
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 1404-1413
Open AccessA Motion is Worth a Hybrid Sentence: Taming Language Model for Unified Motion Generation by Fine-grained Planning
- Top Cited Papers
- 6 October 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. PP (01628828) , 1-15
Lodge++: High-Quality and Long Dance Generation With Robust Choreography Patterns
We propose Lodge++, a choreography framework to generate high-quality, ultra-long dances given the music and desired genre. To handle the challenges in computational efficiency, the complex global choreography patterns across various dance genres, and the physical quality of local dance movements, Lodge++ adopts a two-stage strategy to produce dances from coarse to fine. In the first stage, a global choreography network is designed to generate coarse-grained dance primitives that capture complex global choreography patterns. In the second stage, guided by these dance primitives, a primitive-based dance diffusion model is proposed to further generate high-quality, long-sequence dances in parallel, faithfully adhering to the complex choreography patterns. Additionally, to improve the physical plausibility, Lodge++ employs a penetration guidance module to resolve character self-penetration, a foot refinement module to optimize foot-ground contact, and a multi-genre discriminator to maintain genre consistency throughout the dance. Lodge++ is validated by extensive experiments, which show that our method can rapidly generate ultra-long dances suitable for various dance genres, ensuring well-organized global choreography patterns and high-quality local motion. Code, model and demonstrative video results will be available at https://li-ronghui.github.io/lodgepp.
- 6 October 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. PP (01628828) , 1-15
Top Cited PapersLodge++: High-Quality and Long Dance Generation With Robust Choreography Patterns
We propose Lodge++, a choreography framework to generate high-quality, ultra-long dances given the music and desired genre. To handle the challenges in computational efficiency, the complex global choreography patterns across various dance genres, and the physical quality of local dance movements, Lodge++ adopts a two-stage strategy to produce dances from coarse to fine. In the first stage, a global choreography network is designed to generate coarse-grained dance primitives that capture complex global choreography patterns. In the second stage, guided by these dance primitives, a primitive-based dance diffusion model is proposed to further generate high-quality, long-sequence dances in parallel, faithfully adhering to the complex choreography patterns. Additionally, to improve the physical plausibility, Lodge++ employs a penetration guidance module to resolve character self-penetration, a foot refinement module to optimize foot-ground contact, and a multi-genre discriminator to maintain genre consistency throughout the dance. Lodge++ is validated by extensive experiments, which show that our method can rapidly generate ultra-long dances suitable for various dance genres, ensuring well-organized global choreography patterns and high-quality local motion. Code, model and demonstrative video results will be available at https://li-ronghui.github.io/lodgepp.
- Open Access
- 16 May 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 31 (10) , 8425-8438
CreativeSynth: Cross-Art-Attention for Artistic Image Synthesis With Multimodal Diffusion
Although remarkable progress has been made in image style transfer, style is just one of the components of artistic paintings. Directly transferring extracted style features to natural images often results in outputs with obvious synthetic traces. This is because key painting attributes including layout, perspective, shape, and semantics often cannot be conveyed and expressed through style transfer. Large-scale pretrained text-to-image generation models have demonstrated their capability to synthesize a vast amount of high-quality images. However, even with extensive textual descriptions, it is challenging to fully express the unique visual properties and details of paintings. Moreover, generic models often disrupt the overall artistic effect when modifying specific areas, making it more complicated to achieve a unified aesthetic in artworks. Our main novel idea is to integrate multimodal semantic information as a synthesis guide into artworks, rather than transferring style to the real world. We also aim to reduce the disruption to the harmony of artworks while simplifying the guidance conditions. Specifically, we propose an innovative multi-task unified framework called CreativeSynth, based on the diffusion model with the ability to coordinate multimodal inputs. CreativeSynth combines multimodal features with customized attention mechanisms to seamlessly integrate real-world semantic content into the art domain through Cross-Art-Attention for aesthetic maintenance and semantic fusion. We demonstrate the results of our method across a wide range of different art categories, proving that CreativeSynth bridges the gap between generative models and artistic expression.
- 16 May 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 31 (10) , 8425-8438
Open AccessCreativeSynth: Cross-Art-Attention for Artistic Image Synthesis With Multimodal Diffusion
Although remarkable progress has been made in image style transfer, style is just one of the components of artistic paintings. Directly transferring extracted style features to natural images often results in outputs with obvious synthetic traces. This is because key painting attributes including layout, perspective, shape, and semantics often cannot be conveyed and expressed through style transfer. Large-scale pretrained text-to-image generation models have demonstrated their capability to synthesize a vast amount of high-quality images. However, even with extensive textual descriptions, it is challenging to fully express the unique visual properties and details of paintings. Moreover, generic models often disrupt the overall artistic effect when modifying specific areas, making it more complicated to achieve a unified aesthetic in artworks. Our main novel idea is to integrate multimodal semantic information as a synthesis guide into artworks, rather than transferring style to the real world. We also aim to reduce the disruption to the harmony of artworks while simplifying the guidance conditions. Specifically, we propose an innovative multi-task unified framework called CreativeSynth, based on the diffusion model with the ability to coordinate multimodal inputs. CreativeSynth combines multimodal features with customized attention mechanisms to seamlessly integrate real-world semantic content into the art domain through Cross-Art-Attention for aesthetic maintenance and semantic fusion. We demonstrate the results of our method across a wide range of different art categories, proving that CreativeSynth bridges the gap between generative models and artistic expression.