Comment on egusphere-2022-1221
Open Access
- 11 April 2023
- other
- Published by Copernicus GmbH
- Vol. 2022, 1-49
Abstract
Weighted positive matrix factorization (PMF) has been used by scientists to find small sets of underlying factors in environmental data. However, as the size of the data has grown, increasing computational costs have made it impractical to use traditional methods for this factorization. In this paper, we present a new weighting method to dramatically decrease computational costs for these traditional algorithms. We then apply this weighting method with the Randomized Hierarchical Alternating Least Squares (RHALS) algorithm to a large environmental dataset, where we show that interpretable factors can be reproduced using these methods. We show this algorithm results in a computational speedup of 38, 67, and 634 compared to the Multiplicative Update (MU), deterministic Hierarchical Alternating Least Squares (HALS), and non-negative Alternating Least Squares (ALS) algorithms, respectively. We also investigate rotational ambiguity in the solution, and present a simple “pulling” method to rotate a set of factors. This method is shown to find alternative solutions, and in some cases, lower the weighted residual error of the algorithm.Keywords
This publication has 22 references indexed in Scilit:
- Randomized nonnegative matrix factorizationPattern Recognition Letters, 2018
- A hybrid approach for movie recommendation via tags and ratingsElectronic Commerce Research and Applications, 2016
- Rotational tools for factor analytic modelsJournal of Chemometrics, 2008
- SVD based initialization: A head start for nonnegative matrix factorizationPattern Recognition, 2008
- A graphical diagnostic method for assessing the rotation in factor analytical models of atmospheric pollutionAtmospheric Environment, 2005
- Technical details and programming guide for a general two‐way positive matrix factorization algorithmJournal of Chemometrics, 2004
- Understanding and controlling rotations in factor analytic modelsChemometrics and Intelligent Laboratory Systems, 2002
- Positive matrix factorization: A non‐negative factor model with optimal utilization of error estimates of data valuesEnvironmetrics, 1994
- Analysis of different modes of factor analysis as least squares fit problemsChemometrics and Intelligent Laboratory Systems, 1993
- The Approximation of One Matrix by Another of Lower RankPsychometrika, 1936