The Aesthetics of Disharmony: Harnessing Sounds and Images for Dynamic Soundscapes Generation
Open Access
- 29 September 2023
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Human-Computer Interaction
- Vol. 7 (CHI PLAY) , 665-698
Abstract
This work presents an autonomous approach that explores the dynamic generation of relaxing soundscapes for games and artistic installations. Differently from past works, this system can generate music and images simultaneously, preserving human intent and coherency. We present our algorithm for the generation of audiovisual instances and also a system based on this approach, verifying the quality of the outcomes it can produce in light of current approaches for the generation of images and music. We also instigate the discussion around the new paradigm in arts, where the creative process is delegated to autonomous systems, with limited human participation. Our user study (N=74) shows that our approach overcomes current deep learning models in terms of quality, being recognized as human production, as if the outcome were being generated out of an endless musical improvisation performance.Keywords
This publication has 26 references indexed in Scilit:
- Affective evolutionary music composition with MetaComposeGenetic Programming and Evolvable Machines, 2017
- Modelling Affect for Horror SoundscapesIEEE Transactions on Affective Computing, 2017
- An Introduction to Musical MetacreationComputers in Entertainment, 2016
- Algorithms can Mimic Human Piano Performance: The Deep Blues of MusicJournal of New Music Research, 2016
- Functional Scaffolding for Composing Additional Musical VoicesComputer Music Journal, 2014
- Imaginary soundscapes2014
- Investigating affect in algorithmic composition systemsPsychology of Music, 2014
- Playful or Gameful?Interactions, 2014
- Reflexive loopers for solo musical improvisation2013
- Natural language processing: an introductionJournal of the American Medical Informatics Association, 2011