Qirui Sun
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Qirui Sun has a total of 38 co-authors. Here are the top co-authors by number of shared publications:
- Haipeng Mi
Tsinghua University, Beijing, China
15 shared publications - Zhihao Yao
Tsinghua University, Beijing, China
12 shared publications - Yao Lu
Tsinghua University
6 shared publications - Guanhong Liu
College of Design and Innovation, Tongji University, Shanghai, China
4 shared publications - Yunyi Ni
Nanyang technological university, Singapore, Singapore
4 shared publications - Hanxuan Li
Tsinghua University, Beijing, China
3 shared publications
Latest Publications
- Open Access
- 13 July 2026
- Published by Association for Computing Machinery (ACM)
- p. 958-969
The Banquet: Participatory Sound Theatre Narratives Driven by Social Ritual Gestures
- 13 July 2026
- Published by Association for Computing Machinery (ACM)
- p. 958-969
Open AccessThe Banquet: Participatory Sound Theatre Narratives Driven by Social Ritual Gestures
- Open Access
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-17
GestuProp: 3D Virtual Reality Prop Generation with Co-Speech Gestures
Virtual Reality (VR) has been widely adopted in domains such as gaming, education, and healthcare, where 3D props play a central role in enabling immersive interaction. With the advancement of generative AI, 3D props can now be created rapidly; however, little research has explored how gestures and speech can be integrated to support prop generation. To address this gap, we introduce GestuProp, a VR prop generation system driven by co-speech gestures. Building on a formative study with 30 participants, we proposed a gesture design space and developed the VR system GestuProp. We then conducted a user study with 14 participants, which showed that GestuProp demonstrates good usability and favorable user experiences, while also revealing how object categories influence gesture use and interaction. These findings highlight the potential of gesture–speech synergy to advance prop generation in VR.
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-17
Open AccessGestuProp: 3D Virtual Reality Prop Generation with Co-Speech Gestures
Virtual Reality (VR) has been widely adopted in domains such as gaming, education, and healthcare, where 3D props play a central role in enabling immersive interaction. With the advancement of generative AI, 3D props can now be created rapidly; however, little research has explored how gestures and speech can be integrated to support prop generation. To address this gap, we introduce GestuProp, a VR prop generation system driven by co-speech gestures. Building on a formative study with 30 participants, we proposed a gesture design space and developed the VR system GestuProp. We then conducted a user study with 14 participants, which showed that GestuProp demonstrates good usability and favorable user experiences, while also revealing how object categories influence gesture use and interaction. These findings highlight the potential of gesture–speech synergy to advance prop generation in VR.
- Open Access
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-16
AI-generated AR Reassembly Guidance from Disassembly Videos to Scaffold Everyday Repair
Repair is a valuable yet challenging activity, especially when product manuals are missing or outdated. Augmented Reality (AR) has been widely explored for repair tasks, but most systems rely on CAD models or pre-constructed assets, which escalate authoring costs and constrain scalability. We introduce RePairAR, a system that leverages multimodal large language models (MLLMs) to generate interactive AR reassembly guidance derived directly from user-recorded egocentric disassembly videos. RePairAR deduces step-part-relation structures, reverses these for reassembly planning, and delivers the guidance through mixed-media AR visualizations. In a user study with repair novices, RePairAR significantly reduced perceived temporal demand compared to traditional how-to videos. Both media improved self-efficacy, with RePairAR providing greater gains. Follow-up interviews revealed the mechanisms behind these effects. We contribute a validated MLLM-driven pipeline and highlight design implications for scalable, situated support in everyday repair practices.
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-16
Open AccessAI-generated AR Reassembly Guidance from Disassembly Videos to Scaffold Everyday Repair
Repair is a valuable yet challenging activity, especially when product manuals are missing or outdated. Augmented Reality (AR) has been widely explored for repair tasks, but most systems rely on CAD models or pre-constructed assets, which escalate authoring costs and constrain scalability. We introduce RePairAR, a system that leverages multimodal large language models (MLLMs) to generate interactive AR reassembly guidance derived directly from user-recorded egocentric disassembly videos. RePairAR deduces step-part-relation structures, reverses these for reassembly planning, and delivers the guidance through mixed-media AR visualizations. In a user study with repair novices, RePairAR significantly reduced perceived temporal demand compared to traditional how-to videos. Both media improved self-efficacy, with RePairAR providing greater gains. Follow-up interviews revealed the mechanisms behind these effects. We contribute a validated MLLM-driven pipeline and highlight design implications for scalable, situated support in everyday repair practices.
- Open Access
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-4
Text-Driven Automated Multi-Character Voice Generation for Narrative Content
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-4
Open AccessText-Driven Automated Multi-Character Voice Generation for Narrative Content
- Open Access
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-4
Gesture2Prop: Conditional VR Prop Generation from Hand Gestures and Speech
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-4
Open AccessGesture2Prop: Conditional VR Prop Generation from Hand Gestures and Speech
- Open Access
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-14
Outline and Detail: A Semantic-Driven Framework for Layered 2D Character Generation
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-14
Open AccessOutline and Detail: A Semantic-Driven Framework for Layered 2D Character Generation
- Open Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Myself, My Child or My Friend: Understanding Player Relationships with AI-Generated Game Characters
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Open AccessMyself, My Child or My Friend: Understanding Player Relationships with AI-Generated Game Characters
- Open Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-6
VoiceForge: A Text-Driven Character Voice Generation System for Narrative Content Creation
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Open AccessVoiceForge: A Text-Driven Character Voice Generation System for Narrative Content Creation
- Top Cited PapersOpen Access
- 11 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-15
Lumina: A Software Tool for Fostering Creativity in Designing Chinese Shadow Puppets
Shadow puppetry, a culturally rich storytelling art, faces challenges transitioning to the digital realm. Creators in the early design phase struggle with crafting intricate patterns, textures, and basic animations while adhering to stylistic conventions - hindering creativity, especially for novices. This paper presents Lumina, a tool to facilitate the early Chinese shadow puppet design stage. Lumina provides contour templates, animations, scene editing tools, and machine-generated traditional puppet patterns. These features liberate creators from tedious tasks, allowing focus on the creative process. Developed based on a formative study with puppet creators, the web-based Lumina enables wide dissemination. An evaluation with 18 participants demonstrated Lumina’s effectiveness and ease of use, with participants successfully creating designs spanning traditional themes to contemporary and science-fiction concepts.
- 11 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-15
Top Cited PapersOpen AccessLumina: A Software Tool for Fostering Creativity in Designing Chinese Shadow Puppets
Shadow puppetry, a culturally rich storytelling art, faces challenges transitioning to the digital realm. Creators in the early design phase struggle with crafting intricate patterns, textures, and basic animations while adhering to stylistic conventions - hindering creativity, especially for novices. This paper presents Lumina, a tool to facilitate the early Chinese shadow puppet design stage. Lumina provides contour templates, animations, scene editing tools, and machine-generated traditional puppet patterns. These features liberate creators from tedious tasks, allowing focus on the creative process. Developed based on a formative study with puppet creators, the web-based Lumina enables wide dissemination. An evaluation with 18 participants demonstrated Lumina’s effectiveness and ease of use, with participants successfully creating designs spanning traditional themes to contemporary and science-fiction concepts.
- Open Access
- 11 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-5
ShadowMaker: Sketch-Based Creation Tool for Digital Shadow Puppetry
Shadow puppetry is a cultural heritage with thousands of years of history, and its digital form has become a popular style in modern artistic creation. Creating high-quality shadow puppet works is often challenging. We present "ShadowMaker," an intelligent collaborative tool, where designers can co-create dynamic digital shadow puppets together with AI through prompts and sketching. ShadowMaker introduces a novel non-linear workflow, allowing users to freely switch between stages like sketching, layout, and animating.The user study with 18 participants demonstrated that ShadowMaker is easy to use, offers a high degree of creative freedom, and is capable of inspiring users’ creativity and inspiration.
- 11 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-5
Open AccessShadowMaker: Sketch-Based Creation Tool for Digital Shadow Puppetry
Shadow puppetry is a cultural heritage with thousands of years of history, and its digital form has become a popular style in modern artistic creation. Creating high-quality shadow puppet works is often challenging. We present "ShadowMaker," an intelligent collaborative tool, where designers can co-create dynamic digital shadow puppets together with AI through prompts and sketching. ShadowMaker introduces a novel non-linear workflow, allowing users to freely switch between stages like sketching, layout, and animating.The user study with 18 participants demonstrated that ShadowMaker is easy to use, offers a high degree of creative freedom, and is capable of inspiring users’ creativity and inspiration.