Blind and Spatially-Regularized Online Joint Optimization of Source Separation, Dereverberation, and Noise Reduction
- 9 January 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ACM Transactions on Audio, Speech, and Language Processing
- Vol. 32 (23299290) , 1157-1172
Abstract
This paper proposes a computationally efficient joint optimization algorithm that performs online source separation, dereverberation, and noise reduction based on blind and spatially-regularized processing. When applying such online Blind Source Separation (BSS) as online Independent Vector Extraction (IVE) to a speech application, we must focus on the trade-off between the algorithmic delay and separation accuracy, both of which depend on the analysis frame length. In addition, to separate the sources with specified source permutation, researchers introduced spatial regularization based on the Directions-of-Arrival (DOAs) of the sources into IVE. However, the scale ambiguity of IVE often makes the spatial regularization work inappropriately. To solve these problems, we first propose a blind online joint optimization algorithm of IVE and weighted prediction error dereverberation (WPE). This online algorithm can achieve accurate separation even using short analysis frames because reverberation can be reduced using WPE. We then extend the online joint optimization with robust spatial regularization. We reveal that regularizing the scale of the separated signals is very effective in making the DOA-based spatial regularization work reliably. Our experiments confirm that our blind online joint optimization algorithm can significantly improve the separation accuracy with an algorithmic delay of 8 ms. In addition, we confirm that the proposed spatially-regularized online joint optimization algorithm reduces the rate of the source permutation error to zero percent.Keywords
Funding Information
- JSPS KAKENHI (19H04131)
- JST SPRING (JPMJSP2128)
This publication has 44 references indexed in Scilit:
- Joint Dereverberation and Separation With Iterative Source Steering2021
- Low Latency Online Blind Source Separation Based on Joint Optimization with Blind Dereverberation2021
- Blind and Neural Network-Guided Convolutional Beamformer for Joint Denoising, Dereverberation, and Source Separation2021
- Independent Vector Extraction for Fast Joint Blind Source Separation and DereverberationIEEE Signal Processing Letters, 2021
- Geometrically Constrained Independent Vector Analysis for Directional Speech Enhancement2020
- Overdetermined Independent Vector Analysis2020
- Adaptive Blind Audio Source Extraction Supervised By Dominant Speaker Identification Using X-Vectors2020
- Determined Blind Source Separation with Independent Low-Rank Matrix Analysis2018
- A new regularized forward blind source separation algorithm for automatic speech quality enhancementApplied Acoustics, 2016
- A Geometrically Constrained Independent Vector Analysis Algorithm for Online Source Extraction2015