On-the-Fly Audio Source Separation—A Novel User-Friendly Framework
Authors:
- 23 November 2016
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ACM Transactions on Audio, Speech, and Language Processing
- Vol. 25 (2) , 261-272
Abstract
This paper addresses the challenging problem of single-channel audio source separation. We introduce a novel user-guided framework where source models that govern the separation process are learned on-the-fly from audio examples retrieved online. The user only provides the search keywords that describe the sources in the mixture. In this framework, the generic spectral characteristics of each source are modeled by a universal sound class model learned from the retrieved examples via nonnegative matrix factorization. We propose several group sparsity-inducing constraints in order to efficiently exploit a relevant subset of the universal model adapted to the mixture to be separated. We then derive the corresponding multiplicative update rules for parameter estimation. Separation results obtained from automated and user tests on mixtures containing various types of sounds confirm the effectiveness of the proposed framework.Keywords
This publication has 27 references indexed in Scilit:
- Score-Informed Source Separation for Musical Audio Recordings: An overviewIEEE Signal Processing Magazine, 2014
- The signal separation evaluation campaign (2007–2010): Achievements and remaining challengesSignal Processing, 2012
- Algorithms for Nonnegative Matrix Factorization with the β-DivergenceNeural Computation, 2011
- Nonnegative Matrix Factorization with the Itakura-Saito Divergence: With Application to Music AnalysisNeural Computation, 2009
- Supervised and Semi-supervised Separation of Sounds from Single-Channel Mixtures2007
- MAP-Based Underdetermined Blind Source Separation of Convolutive Mixtures by Hierarchical Clustering and -Norm MinimizationEURASIP Journal on Advances in Signal Processing, 2006
- Blind Separation of Speech Mixtures via Time-Frequency MaskingIEEE Transactions on Signal Processing, 2004
- A Tutorial on MM AlgorithmsThe American Statistician, 2004
- Underdetermined blind source separation using sparse representationsSignal Processing, 2001
- Speaker Verification Using Adapted Gaussian Mixture ModelsDigital Signal Processing, 2000