A Distributed HALS Algorithm for Euclidean Distance-Based Nonnegative Matrix Factorization
- 1 December 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1332-1337
Abstract
This paper proposes a distributed algorithm for multiple agents to perform the Nonnegative Matrix Factorization (NMF) based on the Euclidean distance. The matrix to be factorized is partitioned into multiple blocks, and each block is assigned to one of the agents forming a two-dimensional grid network. Each agent handles a small number of entries of the factor matrices corresponding to the assigned block, and updates their values by using information coming from the neighbors. It is shown that the proposed algorithm simulates the hierarchical alternating least squares method, which is well known as a fast algorithm for NMF based on the Euclidean distance, by making use of a finite-time distributed consensus algorithm.Keywords
This publication has 22 references indexed in Scilit:
- Global convergence of a modified HALS algorithm for nonnegative matrix factorization2015
- A Distributed Algorithm for Solving a Linear Algebraic EquationIEEE Transactions on Automatic Control, 2015
- Global convergence of modified multiplicative updates for nonnegative matrix factorizationComputational Optimization and Applications, 2013
- Algorithms for nonnegative matrix and tensor factorizations: a unified view based on block coordinate descent frameworkJournal of Global Optimization, 2013
- Hierarchical ALS Algorithms for Nonnegative Matrix and 3D Tensor Factorization2007
- Projected Gradient Methods for Nonnegative Matrix FactorizationNeural Computation, 2007
- Finite-Time Distributed Consensus in Graphs with Time-Invariant TopologiesAmerican Control Conference (ACC), 2007
- Fast linear iterations for distributed averagingSystems & Control Letters, 2004
- Text Mining using Non-Negative Matrix Factorizations2004
- Positive matrix factorization: A non‐negative factor model with optimal utilization of error estimates of data valuesEnvironmetrics, 1994