Ensemble System of Deep Neural Networks for Single-Channel Audio Separation
Open Access
- 21 June 2023
- journal article
- research article
- Published by MDPI AG in Information
- Vol. 14 (7) , 352
Abstract
Speech separation is a well-known problem, especially when there is only one sound mixture available. Estimating the Ideal Binary Mask (IBM) is one solution to this problem. Recent research has focused on the supervised classification approach. The challenge of extracting features from the sources is critical for this method. Speech separation has been accomplished by using a variety of feature extraction models. The majority of them, however, are concentrated on a single feature. The complementary nature of various features have not been thoroughly investigated. In this paper, we propose a deep neural network (DNN) ensemble architecture to completely explore the complimentary nature of the diverse features obtained from raw acoustic features. We examined the penultimate discriminative representations instead of employing the features acquired from the output layer. The learned representations were also fused to produce a new features vector, which was then classified by using the Extreme Learning Machine (ELM). In addition, a genetic algorithm (GA) was created to optimize the parameters globally. The results of the experiments showed that our proposed system completely considered various features and produced a high-quality IBM under different conditions.Keywords
This publication has 47 references indexed in Scilit:
- Informed Single-Channel Speech Separation Using HMM–GMM User-Generated Exemplar SourceIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2014
- Single-Channel Blind Separation Using Pseudo-Stereo Mixture and Complex 2-D HistogramIEEE Transactions on Neural Networks and Learning Systems, 2013
- The PASCAL CHiME speech separation and recognition challengeComputer Speech & Language, 2013
- Mask classification for missing-feature reconstruction for robust speech recognition in unknown background noiseSpeech Communication, 2011
- An algorithm that improves speech intelligibility in noise for normal-hearing listenersThe Journal of the Acoustical Society of America, 2009
- Nonnegative Matrix Factorization with the Itakura-Saito Divergence: With Application to Music AnalysisNeural Computation, 2009
- Learning Deep Architectures for AIFoundations and Trends in Machine Learning, 2009
- Monaural Speech Segregation Based on Pitch Tracking and Amplitude ModulationIEEE Transactions on Neural Networks, 2004
- Computational auditory scene analysisComputer Speech & Language, 1994
- RASTA processing of speechIEEE Transactions on Speech and Audio Processing, 1994