Using Sequential Information in Polyphonic Sound Event Detection
Authors:
- 1 September 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 291-295
Abstract
To detect the class, and start and end times of sound events in real world recordings is a challenging task. Current computer systems often show relatively high frame-wise accuracy but low event-wise accuracy. In this paper, we attempted to merge the gap by explicitly including sequential information to improve the performance of a state-of-the-art polyphonic sound event detection system. We propose to 1) use delayed predictions of event activities as additional input features that are fed back to the neural network; 2) build N-grams to model the co-occurrence probabilities of different events; 3) use se-quentialloss to train neural networks. Our experiments on a corpus of real world recordings show that the N-grams could smooth the spiky output of a state-of-the-art neural network system, and improve both the frame-wise and the event-wise metrics.Keywords
This publication has 14 references indexed in Scilit:
- Convolutional Recurrent Neural Networks for Polyphonic Sound Event DetectionIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2017
- A first attempt at polyphonic sound event detection using connectionist temporal classification2017
- Metrics for Polyphonic Sound Event DetectionApplied Sciences, 2016
- Audio-based multimedia event detection using deep recurrent neural networks2016
- Machine translation based data augmentation for Cantonese keyword spotting2016
- Recurrent neural networks for polyphonic sound event detection in real life recordings2016
- An End-to-End Neural Network for Polyphonic Piano Music TranscriptionIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2016
- Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research GroupsIEEE Signal Processing Magazine, 2012
- Joint acoustic and language modeling for speech recognitionSpeech Communication, 2010
- Connectionist temporal classification2006