The bag-of-frames approach: a not so sufficient model for urban soundscapes
Preprint
Abstract
The "bag-of-frames" approach (BOF), which encodes audio signals as the long-term statistical distribution of short-term spectral features, is commonly regarded as an effective and sufficient way to represent environmental sound recordings (soundscapes) since its introduction in an influential 2007 article. The present paper describes a concep-tual replication of this seminal article using several new soundscape datasets, with results strongly questioning the adequacy of the BOF approach for the task. We show that the good accuracy originally re-ported with BOF likely result from a particularly thankful dataset with low within-class variability, and that for more realistic datasets, BOF in fact does not perform significantly better than a mere one-point av-erage of the signal's features. Soundscape modeling, therefore, may not be the closed case it was once thought to be. Progress, we ar-gue, could lie in reconsidering the problem of considering individual acoustical events within each soundscape.Keywords
All Related Versions
This publication has 10 references indexed in Scilit:
- Acoustic Scene Classification: Classifying environments from the sounds they produceIEEE Signal Processing Magazine, 2015
- A Systematic Evaluation of the Bag-of-Frames Representation for Music Information RetrievalIEEE Transactions on Multimedia, 2014
- Detection and classification of acoustic scenes and events: An IEEE AASP challenge2013
- Capturing the workflows of music information retrieval for repeatability and reuseJournal of Intelligent Information Systems, 2013
- An ear for statisticsNature Neuroscience, 2013
- Summary statistics in auditory perceptionNature Neuroscience, 2013
- Judging the similarity of soundscapes does not require categorization: Evidence from spliced stimuliThe Journal of the Acoustical Society of America, 2009
- Perceptual study of soundscapes in train stationsApplied Acoustics, 2008
- The bag-of-frames approach to audio pattern recognition: A sufficient model for urban soundscapes but not for polyphonic musicThe Journal of the Acoustical Society of America, 2007
- Effects of Context on the Identification of Everyday SoundsHuman Performance, 1991