Music Creation Using a Hybrid Model of LLM And LSTM
Open Access
- 29 April 2025
- journal article
- Published by Perception Publishing in The Voice of Creative Research
- Vol. 7 (2) , 323-335
Abstract
Over the years music generation using artificial intelligence and deep learning have undergone lots of progress. There are platforms such as Magneta, MuseNet, Deep Back which incorporates deep learning and LSTM models in their architecture. Along with that platform such as music, riffusion, MIDI which incorporates LLM based learning methods. These models are useful, but there are very few researches which incorporate LLM and LSTM architecture for music generation and improve their individual limitations and combine their strengths. Hence, this will be the major highlight of the research. The LLM based models offer sequential structural richness and LSTM ensures temporal consistency. The approach will involve encoding MIDI sequences into English text format, allowing the LLM to process musical structures with natural language processing techniques. The output is then refined using an LSTM-based decoder to enhance the coherence of note transitions and rhythmic consistency. The hybrid model approaches to discover the potential of combining sequence modelling for improved AI driven music composition, which can make an interesting blend between creativity and machines.Keywords
This publication has 5 references indexed in Scilit:
- Exploring Hybrid GRU-LSTM Networks for Enhanced Music GenerationInternational Journal of Electronics and Communication Engineering, 2024
- MRBERT: Pre-Training of Melody and Rhythm for Automatic Music GenerationMathematics, 2023
- LSTM Based Music Generation SystemIARJSET, 2019
- MuseGAN: Multi-track Sequential Generative Adversarial Networks for Symbolic Music Generation and AccompanimentProceedings of the AAAI Conference on Artificial Intelligence, 2018
- Finding temporal structure in music: blues improvisation with LSTM recurrent networks2003