A framework for computer-assisted sound design systems supported by modelling affective and perceptual properties of soundscape
Authors:
- 1 March 2019
- journal article
- research article
- Published by Taylor & Francis in Journal of New Music Research
- Vol. 48 (3) , 264-280
Abstract
Autonomously generating artificial soundscapes for video games, virtual reality, and sound art presents several non-trivial challenges. We outline a system called Audio Metaphor that is built upon the notion that sound design for soundscape compositions is emotionally informed. We first define the problem space of generating soundscape compositions referencing the sound design and soundscape literature. Next, we survey the state-of-the-art soundscape generation systems and establish the characteristics and challenges for evaluating these types of systems. We then describe the Audio Metaphor system that aims to model the soundscape generation problem using a method of soundscape emotion recognition and segmentation based on perceptual classes, and an autonomous mixing engine utilising optimisation and prediction algorithms to generate a soundscape composition. We evaluate the soundscape compositions generated by Audio Metaphor by comparing them with those created by a human expert and also those generated randomly. Our analysis of the evaluation study reveals that the proposed soundscape generation model is human-competitive regarding semantic and emotion-based indicators.Keywords
Funding Information
- Social Sciences and Humanities Research Council of Canada (Insight)
This publication has 24 references indexed in Scilit:
- Soundscape Composition and Field Recording as a Platform for Collaborative CreativityOrganised Sound, 2011
- Ecological Acoustics Perspective for Content-Based Retrieval of Environmental SoundsEURASIP Journal on Audio, Speech, and Music Processing, 2010
- The Interrogator as Critic: The Turing Test and the Evaluation of Generative Music SystemsComputer Music Journal, 2009
- Emotion perceived and emotion felt: Same and differentMusicae Scientiae, 2006
- The temporal structure of urban soundscapesJournal of Sound and Vibration, 2005
- Score Reliability in Webor Internet-Based Surveys: Unnumbered Graphic Rating Scales versus Likert-Type ScalesEducational and Psychological Measurement, 2001
- What in the World Do We Hear?: An Ecological Approach to Auditory Event PerceptionEcological Psychology, 1993
- Affect Grid: A single-item scale of pleasure and arousal.Journal of Personality and Social Psychology, 1989
- Is There an Optimal Number of Alternatives for Likert Scale Items? Study I: Reliability and ValidityEducational and Psychological Measurement, 1971
- On the Loss of Reliability in Ratings Due to Coarseness of the Scale.Journal of Experimental Psychology, 1924