MusIAC: An extensible generative framework for Music Infilling Applications with multi-level Control

Authors:
  • RGRui Guo
    Rui Guo
  • ISIvor Simpson
    Ivor Simpson
  • CKChris Kiefer
    Chris Kiefer
  • TMThor Magnusson
    Thor Magnusson
  • DHDorien Herremans
    Dorien Herremans
Preprint
Publisher website
Google Scholar
Abstract
We present a novel music generation framework for music infilling, with a user friendly interface. Infilling refers to the task of generating musical sections given the surrounding multi-track music. The proposed transformer-based framework is extensible for new control tokens as the added music control tokens such as tonal tension per bar and track polyphony level in this work. We explore the effects of including several musically meaningful control tokens, and evaluate the results using objective metrics related to pitch and rhythm. Our results demonstrate that adding additional control tokens helps to generate music with stronger stylistic similarities to the original music. It also provides the user with more control to change properties like the music texture and tonal tension in each bar compared to previous research which only provided control for track density. We present the model in a Google Colab notebook to enable interactive generation.
All Related Versions