GLSR-VAE: Geodesic latent space regularization for variational autoencoder architectures
Authors:
- 1 November 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-7
Abstract
VAEs (Variational AutoEncoders) have proved to be powerful in the context of density modeling and have been used in a variety of contexts for creative purposes. In many settings, the data we model possesses continuous attributes that we would like to take into account at generation time. We propose in this paper GLSR-VAE, a Geodesic Latent Space Regularization for the Variational AutoEncoder architecture and its generalizations which allows a fine control on the embedding of the data into the latent space. When augmenting the VAE loss with this regularization, changes in the learned latent space reflects changes of the attributes of the data. This deeper understanding of the VAE latent space structure offers the possibility to modulate the attributes of the generated data in a continuous way. We demonstrate its efficiency on a monophonic music generation task where we manage to generate variations of discrete sequences in an intended and playful way.Keywords
All Related Versions
This publication has 5 references indexed in Scilit:
- Assisted Lead Sheet Composition Using FlowComposer2016
- Information Geometry and Its Applications2016
- Learning Deep Architectures for AIFoundations and Trends in Machine Learning, 2009
- Methods of Information Geometry2007
- Long Short-Term MemoryNeural Computation, 1997