The probabilistic tensor decomposition toolbox
Open Access
- 1 June 2020
- journal article
- research article
- Published by IOP Publishing in Machine Learning: Science and Technology
- Vol. 1 (2) , 025011
Abstract
This article introduces the probabilistic tensor decomposition toolbox-a MATLAB toolbox for tensor decomposition using Variational Bayesian inference and Gibbs sampling. An introduction and overview of probabilistic tensor decomposition and its connection with classical tensor decomposition methods based on maximum likelihood is provided. We subsequently describe the probabilistic tensor decomposition toolbox which encompasses the Canonical Polyadic, Tucker, and Tensor Train decomposition models. Currently, unconstrained, non-negative, orthogonal, and sparse factors are supported. Bayesian inference forms a principled way of incorporating prior knowledge, prediction of held-out data, and estimating posterior probabilities. Furthermore, it facilitates automatic model order determination, automatic regularization on factors (e.g. sparsity), and inherently penalizes model complexity which is beneficial when inferring hierarchical models, such as heteroscedastic noise modelling. The toolbox allows researchers to easily apply Bayesian tensor decomposition methods without the need to derive or implement these methods themselves. Furthermore, it serves as a reference implementation for comparing existing and new tensor decomposition methods. The software is available from https://github.com/JesperLH/prob-tensor-toolbox/.Keywords
This publication has 56 references indexed in Scilit:
- Applications of tensor (multiway array) factorizations and decompositions in data miningWIREs Data Mining and Knowledge Discovery, 2011
- A Parametric Empirical Bayesian Framework for the EEG/MEG Inverse Problem: Generative Models for Multi-Subject and Multi-Modal IntegrationFrontiers in Human Neuroscience, 2011
- Approximate Bayesian Inference for Latent Gaussian models by using Integrated Nested Laplace ApproximationsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2009
- Models with a Kronecker product covariance structure: Estimation and testingMathematical Methods of Statistics, 2008
- Bootstrap confidence intervals for three‐way methodsJournal of Chemometrics, 2004
- The N-way Toolbox for MATLABChemometrics and Intelligent Laboratory Systems, 2000
- Exploratory study of sugar production using fluorescence spectroscopy and multi-way analysisChemometrics and Intelligent Laboratory Systems, 1999
- Chemometrics in food science—a demonstration of the feasibility of a highly exploratory, inductive evaluation strategy of fundamental scientific significanceChemometrics and Intelligent Laboratory Systems, 1998
- PARAFAC. Tutorial and applicationsChemometrics and Intelligent Laboratory Systems, 1997
- Accurate Approximations for Posterior Moments and Marginal DensitiesJournal of the American Statistical Association, 1986