Recurrent Neural Networks for Music Computation
Author:
- 1 August 2006
- journal article
- Published by Institute for Operations Research and the Management Sciences (INFORMS) in INFORMS Journal on Computing
- Vol. 18 (3) , 321-338
Abstract
Some researchers in the computational sciences have considered music computation, including music reproduction and generation, as a dynamic system, i.e., a feedback process. The key element is that the state of the musical system depends on a history of past states. Recurrent (neural) networks have been deployed as models for learning musical processes. We first present a tutorial discussion of recurrent networks, covering those that have been used for music learning. Following this, we examine a thread of development of these recurrent networks for music computation that shows how more intricate music has been learned as the state of the art in recurrent networks improves. We present our findings that show that a long short-term memory recurrent network, with new representations that include music knowledge, can learn musical tasks, and can learn to reproduce long songs. Then, given a reharmonization of the chordal structure, it can generate an improvisation.Keywords
This publication has 12 references indexed in Scilit:
- Learning the Long-Term Structure of the Blues2002
- Recurrent Neural Networks for Prediction2001
- Learning to Forget: Continual Prediction with LSTMNeural Computation, 2000
- Musical Networks1999
- Long Short-Term MemoryNeural Computation, 1997
- The well-tempered computerPhilosophical Transactions A, 1994
- Neural Network Music Composition by Prediction: Exploring the Benefits of Psychoacoustic Constraints and Multi-scale ProcessingConnection Science, 1994
- Resonance and the Perception of Musical MeterConnection Science, 1994
- An Efficient Gradient-Based Algorithm for On-Line Training of Recurrent Network TrajectoriesNeural Computation, 1990
- Toward a Universal Law of Generalization for Psychological ScienceScience, 1987