Tensor-Based Sparse Bayesian Learning With Intra-Dimension Correlation
- 19 January 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Signal Processing
- Vol. 71 (1053587X) , 31-46
Abstract
Unlike the flat-view matrix, tensor provides an elegant representation to preserve the structure of data in the multidimensional nature. The wide use of tensor-based approaches highlights the limitation of matrix-based methods and has generated increasing needs in multidimensional data analytics. Driven by such demands, tensor decomposition with automatic rank determination has recently emerged as a promising tool for image processing, wireless communications and neural network compression. However, unlike the success in matrix-based schemes of exploring the correlation for performance improvement, existing tensor-based methods fail to consider the correlation structure in the tensor. In this paper, we propose to exploit the tensor intra-dimension correlation within the framework of sparse Bayesian learning. We provide the sparsity-inducing probabilistic models under both canonical polyadic decomposition and Tucker decomposition to capture the correlation structure effectively. We derive an efficient model inference method with a fast convergence rate based on the expectation-maximization algorithm. Furthermore, a complexity reduction method is proposed to speed up the computation by exploiting several properties of the Kronecker product. We further extend the proposed framework for the incomplete tensor corrupted by sparse outliers to achieve effective tensor completion and outlier mitigation. Simulation results demonstrate the superior performance of the proposed framework over those ignoring the intra-dimension correlation in terms of accuracy and sparsity.Keywords
Funding Information
- National Natural Science Foundation of China (62201162)
- Natural Sciences and Engineering Research Council of Canada
- Canada Discovery (RGPIN-2017-05201, RGPIN-2018-03792)
- Ministerio de Industria, Energía y Turismo (5404-2061-101)
This publication has 37 references indexed in Scilit:
- Novel Wideband DOA Estimation Based on Sparse Bayesian Learning With Dirichlet Process PriorsIEEE Transactions on Signal Processing, 2015
- Bayesian Robust Tensor Factorization for Incomplete Multiway DataIEEE Transactions on Neural Networks and Learning Systems, 2015
- Tensor Decompositions for Signal Processing Applications: From two-way to multiway component analysisIEEE Signal Processing Magazine, 2015
- Bayesian CP Factorization of Incomplete Tensors with Automatic Rank DeterminationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Compressed Sensing of EEG for Wireless Telemonitoring With Low Energy Consumption and Inexpensive HardwareIEEE Transactions on Biomedical Engineering, 2013
- Tensor-Train DecompositionSIAM Journal on Scientific Computing, 2011
- Iterative Reweighted $\ell_1$ and $\ell_2$ Methods for Finding Sparse SolutionsIEEE Journal of Selected Topics in Signal Processing, 2010
- Tensor Decompositions and ApplicationsSIAM Review, 2009
- Decompositions of a Higher-Order Tensor in Block Terms—Part II: Definitions and UniquenessSIAM Journal on Matrix Analysis and Applications, 2008
- Sparse Bayesian Learning for Basis SelectionIEEE Transactions on Signal Processing, 2004