Ya Li
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Ya Li has a total of 7 co-authors. Here are the top co-authors by number of shared publications:
- Rongfeng Li
Beijing University of Posts and Telecommunications, China
3 shared publications - Zijin Li
Central Conservatory of Music, Beijing, China
3 shared publications - Junchen Liu
Hainan Advanced Digital Technology and Systems Laboratory, Beijing University of Posts and Telecommunications, Sanya 572400, China
2 shared publications - Linfeng Fan
Department of AI Music and Music Information Technology, Central Conservatory of Music, Beijing 100031, China
2 shared publications - Pei Huang
School of Digital Media and Design Arts, Beijing University of Posts and Telecommunications, Beijing 102206, China
2 shared publications - Fan Bu
Beijing University of Posts and Telecommunications
1 shared publication
Latest Publications
- Open Access
Expressive Dizi Synthesis: Unlimited Synthetic Datasets, Real–Synthetic Integration and Technique Labeling
Digital modeling of traditional Chinese musical instruments significantly lags behind that of their Western counterparts, limiting advances in cultural preservation and related research. This paper addresses score-to-audio generation for the Chinese bamboo flute (dizi), aiming to synthesize expressive audio with human-like performance nuances directly from Musical Instrument Digital Interface (MIDI) scores. Two core challenges remain in existing score-to-audio synthesis methods: first, the scarcity of large-scale paired MIDI-audio training data for traditional Chinese instruments; second, the inability of standard MIDI to encode instrument-specific expressive techniques, such as vibrato, pitch bends, and ornamentations. To address these challenges, we propose a scalable workflow that generates large-scale synthetic MIDI-audio pairs through rule-based score randomization, automated digital audio workstation (DAW) rendering with commercial sample libraries, and standardized feature extraction. Performance technique information is directly encoded into the MIDI stream using out-of-range MIDI note numbers, achieving more effective conditioning than external control methods. Our system is built upon the Musical Instrument Digital Interface–Differentiable Digital Signal Processing (MIDI-DDSP) framework. Large-scale synthetic data is used for pre-training to establish timbral consistency, while real recordings from the University of Rochester Multi-Modal Music Performance (URMP) flute corpus are employed for fine adjustment to achieve expressive dynamic variations. Synthetic data alone yields stable but less expressive outputs, whereas real data alone risks overfitting. The combined strategy achieves a realistic timbre with controllable dynamics and performance techniques.
Open AccessExpressive Dizi Synthesis: Unlimited Synthetic Datasets, Real–Synthetic Integration and Technique Labeling
Digital modeling of traditional Chinese musical instruments significantly lags behind that of their Western counterparts, limiting advances in cultural preservation and related research. This paper addresses score-to-audio generation for the Chinese bamboo flute (dizi), aiming to synthesize expressive audio with human-like performance nuances directly from Musical Instrument Digital Interface (MIDI) scores. Two core challenges remain in existing score-to-audio synthesis methods: first, the scarcity of large-scale paired MIDI-audio training data for traditional Chinese instruments; second, the inability of standard MIDI to encode instrument-specific expressive techniques, such as vibrato, pitch bends, and ornamentations. To address these challenges, we propose a scalable workflow that generates large-scale synthetic MIDI-audio pairs through rule-based score randomization, automated digital audio workstation (DAW) rendering with commercial sample libraries, and standardized feature extraction. Performance technique information is directly encoded into the MIDI stream using out-of-range MIDI note numbers, achieving more effective conditioning than external control methods. Our system is built upon the Musical Instrument Digital Interface–Differentiable Digital Signal Processing (MIDI-DDSP) framework. Large-scale synthetic data is used for pre-training to establish timbral consistency, while real recordings from the University of Rochester Multi-Modal Music Performance (URMP) flute corpus are employed for fine adjustment to achieve expressive dynamic variations. Synthetic data alone yields stable but less expressive outputs, whereas real data alone risks overfitting. The combined strategy achieves a realistic timbre with controllable dynamics and performance techniques.
- Open Access
- 30 June 2026
- Published by MDPI AG in Preprints.org
Expressive Dizi Synthesis: Unlimited Synthetic Datasets, Real–Synthetic Integration and Technique Labeling
The digitized models of Chinese traditional musical instruments have fallen behind those of Western musical instruments, therefore they have restricted the preservation work and the research acquiring. This article deals with score-to-audio generation for the Chinese bamboo flute (dizi), it produces expressive audio from MIDI scores which has human performance detail. The current existing methods have two obstacles that they face. First, the large-scale paired training data (MIDI-audio) for traditional Chinese musical instruments is not much. Second, the already existing systems are not able to control the techniques that are specific to instruments—vibrato, pitch bends, ornaments—which the standard MIDI has no ability to encode. We put forward a expandable working flow that produces infinite artificial MIDI-audio matching groups through rule-based music score random arrangement, automatic DAW drawing output by using business sample storage banks, and systemized character pick-up. The information of technique is directly coded in the MIDI stream through the use of note numbers that lie outside the normal range, which thus proves to be more effective than the method of external conditioning. This system is constructed on the basis of MIDI-DDSP. Pre-training makes use of large-scale man-made data to obtain timbre consistency; The fine adjustment carries out the use of actual recording materials (URMP flute corpus) to realize expressive dynamic changes. Only the synthetic data can generate output that is stable but has no life. The real data which exist alone can bring about the problem of overfitting. This combined result can give realistic tone, which has controllable dynamic changes and playing skills.
- 30 June 2026
- Published by MDPI AG in Preprints.org
Open AccessExpressive Dizi Synthesis: Unlimited Synthetic Datasets, Real–Synthetic Integration and Technique Labeling
The digitized models of Chinese traditional musical instruments have fallen behind those of Western musical instruments, therefore they have restricted the preservation work and the research acquiring. This article deals with score-to-audio generation for the Chinese bamboo flute (dizi), it produces expressive audio from MIDI scores which has human performance detail. The current existing methods have two obstacles that they face. First, the large-scale paired training data (MIDI-audio) for traditional Chinese musical instruments is not much. Second, the already existing systems are not able to control the techniques that are specific to instruments—vibrato, pitch bends, ornaments—which the standard MIDI has no ability to encode. We put forward a expandable working flow that produces infinite artificial MIDI-audio matching groups through rule-based music score random arrangement, automatic DAW drawing output by using business sample storage banks, and systemized character pick-up. The information of technique is directly coded in the MIDI stream through the use of note numbers that lie outside the normal range, which thus proves to be more effective than the method of external conditioning. This system is constructed on the basis of MIDI-DDSP. Pre-training makes use of large-scale man-made data to obtain timbre consistency; The fine adjustment carries out the use of actual recording materials (URMP flute corpus) to realize expressive dynamic changes. Only the synthetic data can generate output that is stable but has no life. The real data which exist alone can bring about the problem of overfitting. This combined result can give realistic tone, which has controllable dynamic changes and playing skills.