Xinyi Tong
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Xinyi Tong has a total of 26 co-authors. Here are the top co-authors by number of shared publications:
- Nian Liu
Beijing University of Posts and Telecommunications, Beijing, China and Beijing Institute for General Artificial Intelligence, Beijing, China
2 shared publications - Bo Zheng
Alibaba Group, Hangzhou, China
1 shared publication Duo Xu
Beijing Institute for General Artificial Intelligence
1 shared publicationFeng Yu
Department of AI Music and Music Information Technology, Central Conservatory of Music
1 shared publication- Feng Yu
Central Conservatory of Music, Beijing, China
1 shared publication Haoxin Zhang
Department of AI Music and Music Information Technology, Central Conservatory of Music
1 shared publication
Latest Publications
- 1 April 2026
- Published by Springer Nature
- p. 87-102
ChordCrafter: Learning Stylistic Distributions for Chord Progression with Monte Carlo Sampling
- 1 April 2026
- Published by Springer Nature
- p. 87-102
ChordCrafter: Learning Stylistic Distributions for Chord Progression with Monte Carlo Sampling
- Open Access
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 10343-10351
Learning Uniformly Distributed Embedding Clusters of Stylistic Skills for Physically Simulated Characters
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 10343-10351
Open AccessLearning Uniformly Distributed Embedding Clusters of Stylistic Skills for Physically Simulated Characters
- 1 October 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computational Social Systems
- Vol. 12 (2) , 905-917
Video Echoed in Harmony: Learning and Sampling Video-Integrated Chord Progression Sequences for Controllable Video Background Music Generation
Automatically generating video background music mitigates the inefficiency and time-consuming drawbacks of current manual video editing. Two key challenges hinder the expansion of the inception of video-to-music tasks. 1) Limited availability of high-quality video–music datasets and annotations. 2) Absence of music generation methods that consider actual musicality, which are controlled by interpretable factors based on music theory. In the article, we propose video echoed in harmony (VEH), a method for learning and sampling video-integrated chord progression sequences. Our approach adopts harmony, represented by chord progressions that are aligned with various music formats [musical instrument digital interface (MIDI), audio, and score], imitating chord precedence in human music composition. Visual-language models link visual features to chord progressions through genre labels and descriptive words in generated textualized videos. The two aforementioned features collectively obviate the necessity of extensive video–music paired data. Besides, an energy-based chord progression learning and sampling algorithm quantifies abstract harmony impressions to statistical features, serving as interpretable factors for the controllable music generation based on music theory. Experimental results demonstrate that the proposed method outperforms the state-of-the-art, producing a superior music alignment for the given video.
- 1 October 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computational Social Systems
- Vol. 12 (2) , 905-917
Video Echoed in Harmony: Learning and Sampling Video-Integrated Chord Progression Sequences for Controllable Video Background Music Generation
Automatically generating video background music mitigates the inefficiency and time-consuming drawbacks of current manual video editing. Two key challenges hinder the expansion of the inception of video-to-music tasks. 1) Limited availability of high-quality video–music datasets and annotations. 2) Absence of music generation methods that consider actual musicality, which are controlled by interpretable factors based on music theory. In the article, we propose video echoed in harmony (VEH), a method for learning and sampling video-integrated chord progression sequences. Our approach adopts harmony, represented by chord progressions that are aligned with various music formats [musical instrument digital interface (MIDI), audio, and score], imitating chord precedence in human music composition. Visual-language models link visual features to chord progressions through genre labels and descriptive words in generated textualized videos. The two aforementioned features collectively obviate the necessity of extensive video–music paired data. Besides, an energy-based chord progression learning and sampling algorithm quantifies abstract harmony impressions to statistical features, serving as interpretable factors for the controllable music generation based on music theory. Experimental results demonstrate that the proposed method outperforms the state-of-the-art, producing a superior music alignment for the given video.