Shumeng Zhang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Shumeng Zhang has a total of 29 co-authors. Here are the top co-authors by number of shared publications:
- Mingming Fan
Computational Media and Arts Thrust, The Hong Kong University of Science and Technology (Guangzhou)
8 shared publications - Tiancheng Liu
The Hong Kong University of Science and Technology (Guangzhou)
5 shared publications - Chen Liang
Computational Media and Arts thrust, The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, Guangdong, China
3 shared publications - Raul Masu
Conservatorio di musica F. A. Bonporti di Trento e Riva del Garda, Trento, Italy and Computational Media and Art, Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China
3 shared publications - Zeyu Wang
The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China
2 shared publications - Zisu Li
IIP (Computational Media and Arts), The Hong Kong University of Science and Technology, Guangzhou, China
2 shared publications
Latest Publications
- Open Access
- 30 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-8
NarraStone: Reimagining the Stone Stele as an Al-Era Apparatus of Synthetic Memory
- 30 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-8
Open AccessNarraStone: Reimagining the Stone Stele as an Al-Era Apparatus of Synthetic Memory
- Open Access
- 29 June 2026
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Computer Graphics and Interactive Techniques
- Vol. 9 (3) , 1-12
To Perform/ To Live: Decolonizing of Digital Music Instruments and Feminism with Human-AI Co-Created Embodied Experience of Daily Objects 45
This paper proposes a decolonial approach to interactive music performance grounded in Chinese everyday life. Responding to critiques that dominant interaction models and evaluation norms often reflect Western legacies, we design locally situated digital musical instruments (DMIs) that treat domestic routines as primary interface logic. Our embodied performance system, To Perform/To Live , repurposes familiar objects used in Chinese women’s daily lives: an abacus, a vegetable washing basin, a soup pot, a fan, and a massage hammer. Across three stages, performers transform counting, soup-making, and restoration gestures into musical control through tempo, pressure, repetition, and pause, rendering gendered labor audible without romanticizing it. After each performance, we extend the work through human–AI co-creation: recorded audio is analyzed to generate a terrain-like surface, 3D printed as a tactile disk that encodes the performance for touch and re-performance. We contribute a China-situated decolonial DMI strategy, a feminist sonic practice of performable labor, and the E2E framework linking embodied knowledge to AI-enabled material extensions.
- 29 June 2026
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Computer Graphics and Interactive Techniques
- Vol. 9 (3) , 1-12
Open AccessTo Perform/ To Live: Decolonizing of Digital Music Instruments and Feminism with Human-AI Co-Created Embodied Experience of Daily Objects 45
This paper proposes a decolonial approach to interactive music performance grounded in Chinese everyday life. Responding to critiques that dominant interaction models and evaluation norms often reflect Western legacies, we design locally situated digital musical instruments (DMIs) that treat domestic routines as primary interface logic. Our embodied performance system, To Perform/To Live , repurposes familiar objects used in Chinese women’s daily lives: an abacus, a vegetable washing basin, a soup pot, a fan, and a massage hammer. Across three stages, performers transform counting, soup-making, and restoration gestures into musical control through tempo, pressure, repetition, and pause, rendering gendered labor audible without romanticizing it. After each performance, we extend the work through human–AI co-creation: recorded audio is analyzed to generate a terrain-like surface, 3D printed as a tactile disk that encodes the performance for touch and re-performance. We contribute a China-situated decolonial DMI strategy, a feminist sonic practice of performable labor, and the E2E framework linking embodied knowledge to AI-enabled material extensions.
- Open Access
- 29 June 2026
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Computer Graphics and Interactive Techniques
- Vol. 9 (3) , 1-13
BruSHŪ: Cross-Modal Translation of Implicit Micro-Actions in Chinese Calligraphy 32
Artworks are often encountered as finished artifacts; Chinese calligraphy is a clear example. The implicit micro-actions that shape a trace, including boundaries, transitions, and timing, are fleeting and often underdetermined by the final work. This gap constrains how practitioners reflect on embodied decisions in everyday practice. We ask how to make these micro-actions perceptible to expert calligraphy artists without turning practice into instruction, assessment, or stroke-faithful reconstruction. We present BruSHŪ , a perceptual lens that translates aspects of the writing process into interpretable cross-modal cues to support in-the-moment noticing and post-hoc reflection. We also articulate a brush-as-lens framework that treats interpretability, adjustability, and non-normative feedback as prerequisites for reflective practice. We examine BruSHŪ through a studio co-creation session with an expert calligrapher and a subsequent live performance deployment, followed by reflection-based inquiry. Our findings suggest that lightweight, tunable cues can surface tacit process structure and support reflection and conversation, provided they preserve established technique and artistic autonomy.
- 29 June 2026
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Computer Graphics and Interactive Techniques
- Vol. 9 (3) , 1-13
Open AccessBruSHŪ: Cross-Modal Translation of Implicit Micro-Actions in Chinese Calligraphy 32
Artworks are often encountered as finished artifacts; Chinese calligraphy is a clear example. The implicit micro-actions that shape a trace, including boundaries, transitions, and timing, are fleeting and often underdetermined by the final work. This gap constrains how practitioners reflect on embodied decisions in everyday practice. We ask how to make these micro-actions perceptible to expert calligraphy artists without turning practice into instruction, assessment, or stroke-faithful reconstruction. We present BruSHŪ , a perceptual lens that translates aspects of the writing process into interpretable cross-modal cues to support in-the-moment noticing and post-hoc reflection. We also articulate a brush-as-lens framework that treats interpretability, adjustability, and non-normative feedback as prerequisites for reflective practice. We examine BruSHŪ through a studio co-creation session with an expert calligrapher and a subsequent live performance deployment, followed by reflection-based inquiry. Our findings suggest that lightweight, tunable cues can surface tacit process structure and support reflection and conversation, provided they preserve established technique and artistic autonomy.
- Open Access
- 14 December 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-8
FinHERtip: Embodied Identity and Human-AI Co-Creation in Accessible Musical Performance
- 14 December 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-8
Open AccessFinHERtip: Embodied Identity and Human-AI Co-Creation in Accessible Musical Performance
- Open Access
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 6730-6739
Quantifying Structural Aesthetic Features and Personality Trait Preferences in Kai Shu Calligraphy
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 6730-6739
Open AccessQuantifying Structural Aesthetic Features and Personality Trait Preferences in Kai Shu Calligraphy
- Open Access
- 22 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-22
Accessibility and Social Inclusivity: A Literature Review of Music Technology for Blind and Low Vision People
- 22 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-22
Open AccessAccessibility and Social Inclusivity: A Literature Review of Music Technology for Blind and Low Vision People
- Open Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-19
InteRecon: Towards Reconstructing Interactivity of Personal Memorable Items in Mixed Reality
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-19
Open AccessInteRecon: Towards Reconstructing Interactivity of Personal Memorable Items in Mixed Reality
- Open Access
- 27 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-14
Beadwork Bridge: Understanding and Exploring the Opportunities of Beadwork in Enriching School Education for Blind and Low Vision (BLV) People
Tactile perception is a crucial channel for education in individuals with blindness and low vision (BLV), and beadwork is a low-cost and widely adopted tool in their educational practices. In this paper, we aim to explore what the field of Human-Computer Interaction (HCI) can learn from beadwork practices in relation to educational somatic experiences and tangible interaction. To understand how beadwork practices are enacted, we conducted in-class observations, semi-structured interviews, and focus groups with BLV students and teachers. Our results suggest that beadwork is an effective tool to foster personal development (e.g., mathematical and creativity skills) and social engagement (e.g., career development). Based on our findings, we offer insights into how beadwork can serve as a cost-effective material for HCI, particularly in the context of embodied cognition and soma design. Finally, we propose how state-of-the-art technology could be integrated to optimize the overall process.
- 27 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-14
Open AccessBeadwork Bridge: Understanding and Exploring the Opportunities of Beadwork in Enriching School Education for Blind and Low Vision (BLV) People
Tactile perception is a crucial channel for education in individuals with blindness and low vision (BLV), and beadwork is a low-cost and widely adopted tool in their educational practices. In this paper, we aim to explore what the field of Human-Computer Interaction (HCI) can learn from beadwork practices in relation to educational somatic experiences and tangible interaction. To understand how beadwork practices are enacted, we conducted in-class observations, semi-structured interviews, and focus groups with BLV students and teachers. Our results suggest that beadwork is an effective tool to foster personal development (e.g., mathematical and creativity skills) and social engagement (e.g., career development). Based on our findings, we offer insights into how beadwork can serve as a cost-effective material for HCI, particularly in the context of embodied cognition and soma design. Finally, we propose how state-of-the-art technology could be integrated to optimize the overall process.
- Open Access
- 1 July 2024
- Published by Association for Computing Machinery (ACM)
- p. 1594-1606
Exploring the Impact of Artificial Intelligence-Generated Content (AIGC) Tools on Social Dynamics in UX Collaboration
Artificial Intelligence-Generated Content (AIGC) tools have gradually been integrated into the daily workflow of UX practitioners. While existing research has explored the integration of AIGC tools in daily workflow, little is known about their impact on social dynamics within UX collaboration. We conducted four focus groups and eight semi-structured interviews with 26 UX practitioners to investigate how AIGC tools influence social dynamics in UX collaboration. Our findings indicated that AIGC tools not only mitigated conflicts but also introduced potential new conflicts. AIGC tools expanded the roles of UX practitioners and fostered a team culture characterized by exploring and discussing. Participants have higher expectations for AI-assisted design in user understanding and prototype evaluation, and team-motivated AI tools learning. Based on these findings, we discussed the benefits and concerns of conflict resolution through AIGC and the importance of teams in AI learning. Finally, we proposed several suggestions for future AI design research.
- 1 July 2024
- Published by Association for Computing Machinery (ACM)
- p. 1594-1606
Open AccessExploring the Impact of Artificial Intelligence-Generated Content (AIGC) Tools on Social Dynamics in UX Collaboration
Artificial Intelligence-Generated Content (AIGC) tools have gradually been integrated into the daily workflow of UX practitioners. While existing research has explored the integration of AIGC tools in daily workflow, little is known about their impact on social dynamics within UX collaboration. We conducted four focus groups and eight semi-structured interviews with 26 UX practitioners to investigate how AIGC tools influence social dynamics in UX collaboration. Our findings indicated that AIGC tools not only mitigated conflicts but also introduced potential new conflicts. AIGC tools expanded the roles of UX practitioners and fostered a team culture characterized by exploring and discussing. Participants have higher expectations for AI-assisted design in user understanding and prototype evaluation, and team-motivated AI tools learning. Based on these findings, we discussed the benefits and concerns of conflict resolution through AIGC and the importance of teams in AI learning. Finally, we proposed several suggestions for future AI design research.