An Experimental Study on Sound Event Localization and Detection Under Realistic Testing Conditions
Authors:
- 4 June 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Abstract
We study four data augmentation (DA) techniques and two model architectures on realistic data for sound event localization and detection (SELD). First, based on ResNet-Conformer (RC), we compare the four DA approaches on the realistic DCASE 2022 SELD test set which is often not easy to handle due to room reverberations and audio overlaps in spontaneous recordings. Experimental results show that, except for audio channel swapping (ACS), the other three data augmentation methods that work well on the simulated SELD data set are no longer effective due to mismatches between simulated and realistic conditions. Next, using ACS-based augmentation, the two improved ResNet-Conformer networks further enhance SELD performances in realistic conditions. By incorporating these two sets of techniques, our overall system ranked the first place in SELD task of the DCASE 2022 Challenge.Keywords
Funding Information
- National Natural Science Foundation of China
This publication has 16 references indexed in Scilit:
- A Sequence Matching Network for Polyphonic Sound Event Localization and Detection2020
- Joint Measurement of Localization and Detection of Sound Events2019
- SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition2019
- First Order Ambisonics Domain Spatial Augmentation for DNN-based Direction of Arrival Estimation2019
- Polyphonic Sound Event Detection and Localization using a Two-Stage Strategy2019
- Sound Event Localization and Detection of Overlapping Sources Using Convolutional Recurrent Neural NetworksIEEE Journal of Selected Topics in Signal Processing, 2018
- Detection, classification and localization of acoustic events in the presence of background noise for acoustic surveillance of hazardous situationsMultimedia Tools and Applications, 2015
- An exemplar-based NMF approach to audio event detection2013
- Scream and gunshot detection and localization for audio-surveillance systems2007
- The generalized correlation method for estimation of time delayIEEE Transactions on Acoustics, Speech, and Signal Processing, 1976