Active-Set Newton Algorithm for Overcomplete Non-Negative Representations of Audio
Authors:
- 14 May 2013
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Audio, Speech, and Language Processing
- Vol. 21 (11) , 2277-2289
Abstract
This paper proposes a computationally efficient algorithm for estimating the non-negative weights of linear combinations of the atoms of large-scale audio dictionaries, so that the generalized Kullback-Leibler divergence between an audio observation and the model is minimized. This linear model has been found useful in many audio signal processing tasks, but the existing algorithms are computationally slow when a large number of atoms is used. The proposed algorithm is based on iteratively updating a set of active atoms, with the weights updated using the Newton method and the step size estimated such that the weights remain non-negative. Algorithm convergence evaluations on representing audio spectra that are mixtures of two speakers show that with all the tested dictionary sizes the proposed method reaches a much lower value of the divergence than can be obtained by conventional algorithms, and is up to 8 times faster. A source separation evaluation revealed that when using large dictionaries, the proposed method produces a better separation quality in less time.Keywords
This publication has 40 references indexed in Scilit:
- Iterative hard thresholding for compressed sensingApplied and Computational Harmonic Analysis, 2009
- Nonnegative Matrix Factorization with the Itakura-Saito Divergence: With Application to Music AnalysisNeural Computation, 2009
- Bayesian Inference for Nonnegative Matrix Factorisation ModelsComputational Intelligence and Neuroscience, 2009
- Fast Local Algorithms for Large Scale Nonnegative Matrix and Tensor FactorizationsIEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, 2009
- Fast Nonnegative Matrix Factorization Algorithms Using Projected Gradient Approaches for Large-Scale ProblemsComputational Intelligence and Neuroscience, 2008
- An Interior-Point Method for Large-Scale -Regularized Least SquaresIEEE Journal of Selected Topics in Signal Processing, 2007
- An interior point Newton‐like method for non‐negative least‐squares problems with degenerate solutionNumerical Linear Algebra with Applications, 2006
- Least angle regressionThe Annals of Statistics, 2004
- Methods to speed up error back-propagation learning algorithmACM Computing Surveys, 1995
- Matching pursuits with time-frequency dictionariesIEEE Transactions on Signal Processing, 1993