Newton-Based Optimization for Nonnegative Tensor Factorizations

Authors:
  • SHSamantha Hansen
    Samantha Hansen
  • TPTodd Plantenga
    Todd Plantenga
  • TKTamara G. Kolda
    Tamara G. Kolda

Abstract
Tensor factorizations with nonnegative constraints have proved to be powerful tools for analysis of sparse count data in areas such as bioinformatics and social network analysis. We consider application data best described as being generated by a Poisson process (e.g., count data), which leads to sparse tensors that are typically modeled by sparse factor matrices. In this paper we investigate efficient techniques for computing an appropriate tensor factorization model and propose new subproblem solvers within the standard alternating block variable approach. Our new methods exploit structure and reformulate the optimization problem as small independent subproblems. We employ bound-constrained Newton and quasi-Newton methods. We compare our algorithms against other codes, demonstrating superior speed for high accuracy results and the ability to quickly find sparse solutions.

This publication has 15 references indexed in Scilit: