Zhengyang Ma
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Zhengyang Ma has a total of 10 co-authors. Here are the top co-authors by number of shared publications:
- Xuetong Wang
Division of Emerging Interdisciplinary Areas, Hong Kong University of Science and Technology, Kowloon, Hong Kong SAR, China
2 shared publications - Iurii Kuzmin
Individualized Interdisciplinary Program (IIP), The Hong Kong University of Science and Technology, Hong Kong, Hong Kong
1 shared publication - Jeremy Tzi Dong Ng
The University of Hong Kong
1 shared publication - Raul Masu
Conservatorio di musica F. A. Bonporti di Trento e Riva del Garda, Trento, Italy and Computational Media and Art, Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China
1 shared publication - Serkan Kumyol
Hong Kong University of Science and Technology, Hong Kong, Hong Kong
1 shared publication - Shiqi Lin
The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China
1 shared publication
Latest Publications
- Open Access
- 30 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-2
CyHulu: Reconfigurable Hulusi and an Embodied Digital Companion for Live Performance
- 30 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-2
Open AccessCyHulu: Reconfigurable Hulusi and an Embodied Digital Companion for Live Performance
- Open Access
- 2 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-3
Demonstrating HexBlocks: An Open-Source Framework for Prototyping Reconfigurable Interactive Physical Interfaces with Semantic Continuity
- 2 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-3
Open AccessDemonstrating HexBlocks: An Open-Source Framework for Prototyping Reconfigurable Interactive Physical Interfaces with Semantic Continuity
- Open Access
- 2 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-2
HexBot: Authoring Reconfigurable Multi-Robot Interfaces through Snap-On Capabilities
- 2 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-2
Open AccessHexBot: Authoring Reconfigurable Multi-Robot Interfaces through Snap-On Capabilities
- Open Access
- 4 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 258-262
Han-Vibe: Culturally-Situated Multimodal Interaction for AI-Mediated Live Music Performance
We present Han-Vibe, a terminal-based multimodal system for live electronic music performance that unifies direct manipulation, live DSP editing, AI-mediated natural-language control, offline voice triggers, and community resource sharing in a culturally situated workflow we term vibe performing. The design draws on hanmai (喊麦), a Chinese internet music tradition in which an MC’s voice modulates a live-streamed performance. Han-Vibe organizes three input modalities (tactile, linguistic, vocal) into four interaction paradigms: TuneTouch (keyboard parameter control), LiveForge (hot-reloadable Faust DSP editing), VibeLink-Text (LLM-mediated typed intent), and VibeLink-Voice (offline keyword-to-scene mapping). The PulseHub (脉冲社) resource layer supplies reusable DSP and scenes through VibeLink-Text. We report component-level latency measurements as a necessary technical characterization, not an evaluation of usability or creative value. Completed asynchronous commands are scheduled at the first subsequent bar boundary, preserving grid alignment while leaving the performer’s waiting time variable. We discuss the contribution and limits of this culturally situated design case.
- 4 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 258-262
Open AccessHan-Vibe: Culturally-Situated Multimodal Interaction for AI-Mediated Live Music Performance
We present Han-Vibe, a terminal-based multimodal system for live electronic music performance that unifies direct manipulation, live DSP editing, AI-mediated natural-language control, offline voice triggers, and community resource sharing in a culturally situated workflow we term vibe performing. The design draws on hanmai (喊麦), a Chinese internet music tradition in which an MC’s voice modulates a live-streamed performance. Han-Vibe organizes three input modalities (tactile, linguistic, vocal) into four interaction paradigms: TuneTouch (keyboard parameter control), LiveForge (hot-reloadable Faust DSP editing), VibeLink-Text (LLM-mediated typed intent), and VibeLink-Voice (offline keyword-to-scene mapping). The PulseHub (脉冲社) resource layer supplies reusable DSP and scenes through VibeLink-Text. We report component-level latency measurements as a necessary technical characterization, not an evaluation of usability or creative value. Completed asynchronous commands are scheduled at the first subsequent bar boundary, preserving grid alignment while leaving the performer’s waiting time variable. We discuss the contribution and limits of this culturally situated design case.
- Open Access
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-23
Orchid-Creator: An Authoring Tool Supporting LLM-Driven Interactive Narrative Creation
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-23
Open AccessOrchid-Creator: An Authoring Tool Supporting LLM-Driven Interactive Narrative Creation
- Open Access
- 3 March 2025
- Published by Association for Computing Machinery (ACM)
- p. 963-969
Multimodal learning analytics for game-based assessment of collaborative problem solving skills among young students
Collaborative Problem Solving (CPS) has emerged as a key competence for the 21st century. In support of this, valid assessments of CPS skills have become critical. However, limited research has designed and developed CPS assessments for young students. Based on multimodal learning analytics, we aim to develop and validate a game-based assessment of CPS for primary school students. In this study, evidence centered design approach was used to design and develop the game-based CPS assessment. Specifically, we designed and developed a mobile multiplayer online 3D role-playing game on CPS and a coding scheme for coding students’ gameplay data (i.e., game logs and voice chat) based on the ATC21S CPS framework. A total of 32 primary 5 students participated in this study to play the game in a group of four and complete a questionnaire of CPS skills. The gameplay data were coded based on our coding scheme. Correlation analysis between the coded results and the CPS questionnaire data supported the criterion validity of our game-based assessment measure. Additionally, the results of expert interview facilitated our understanding of assessment design and data use. This study will make methodological and practical contributions to the integration of MMLA into game-based CPS assessments.
- 3 March 2025
- Published by Association for Computing Machinery (ACM)
- p. 963-969
Open AccessMultimodal learning analytics for game-based assessment of collaborative problem solving skills among young students
Collaborative Problem Solving (CPS) has emerged as a key competence for the 21st century. In support of this, valid assessments of CPS skills have become critical. However, limited research has designed and developed CPS assessments for young students. Based on multimodal learning analytics, we aim to develop and validate a game-based assessment of CPS for primary school students. In this study, evidence centered design approach was used to design and develop the game-based CPS assessment. Specifically, we designed and developed a mobile multiplayer online 3D role-playing game on CPS and a coding scheme for coding students’ gameplay data (i.e., game logs and voice chat) based on the ATC21S CPS framework. A total of 32 primary 5 students participated in this study to play the game in a group of four and complete a questionnaire of CPS skills. The gameplay data were coded based on our coding scheme. Correlation analysis between the coded results and the CPS questionnaire data supported the criterion validity of our game-based assessment measure. Additionally, the results of expert interview facilitated our understanding of assessment design and data use. This study will make methodological and practical contributions to the integration of MMLA into game-based CPS assessments.
- Open Access
- 18 September 2024
- Published by Association for Computing Machinery (ACM)
- p. 468-478
Locality and Digital Musical Instruments Design: A User Study
This paper explores the possibility of applying the notion of cosmotechnics —the concept that advocates for reciprocal relations between technology and local cultural and ecological contexts—in the field of Digital Musical Instruments (DMI) design. We present zhu nao, a DMI that takes inspiration from traditional and contemporary culture of China, as a research probe to investigate how locality (one of the key ideas of cosmotechnical thought) is inscribed in musical instruments by designers and perceived by players. Our study involved ten participants from diverse backgrounds engaging with zhu nao. We aimed not to evaluate the instrument per se, but rather to understand how its design, rooted in specific cultural and environmental considerations, resonates with players. The findings reveal that zhu nao evoked a spectrum of personal and cultural associations, highlighting the rich potential of incorporating cosmotechnical approaches into DMI design. This work contributes to the discourse on technodiversity in music technology, suggesting new pathways for creating instruments that deeply resonate with players and their cultural landscapes.
- 18 September 2024
- Published by Association for Computing Machinery (ACM)
- p. 468-478
Open AccessLocality and Digital Musical Instruments Design: A User Study
This paper explores the possibility of applying the notion of cosmotechnics —the concept that advocates for reciprocal relations between technology and local cultural and ecological contexts—in the field of Digital Musical Instruments (DMI) design. We present zhu nao, a DMI that takes inspiration from traditional and contemporary culture of China, as a research probe to investigate how locality (one of the key ideas of cosmotechnical thought) is inscribed in musical instruments by designers and perceived by players. Our study involved ten participants from diverse backgrounds engaging with zhu nao. We aimed not to evaluate the instrument per se, but rather to understand how its design, rooted in specific cultural and environmental considerations, resonates with players. The findings reveal that zhu nao evoked a spectrum of personal and cultural associations, highlighting the rich potential of incorporating cosmotechnical approaches into DMI design. This work contributes to the discourse on technodiversity in music technology, suggesting new pathways for creating instruments that deeply resonate with players and their cultural landscapes.