MR-NTD: Manifold Regularization Nonnegative Tucker Decomposition for Tensor Data Dimension Reduction and Representation
Authors:
- 27 April 2016
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 28 (8) , 1787-1800
Abstract
With the advancement of data acquisition techniques, tensor (multidimensional data) objects are increasingly accumulated and generated, for example, multichannel electroencephalographies, multiview images, and videos. In these applications, the tensor objects are usually nonnegative, since the physical signals are recorded. As the dimensionality of tensor objects is often very high, a dimension reduction technique becomes an important research topic of tensor data. From the perspective of geometry, high-dimensional objects often reside in a low-dimensional submanifold of the ambient space. In this paper, we propose a new approach to perform the dimension reduction for nonnegative tensor objects. Our idea is to use nonnegative Tucker decomposition (NTD) to obtain a set of core tensors of smaller sizes by finding a common set of projection matrices for tensor objects. To preserve geometric information in tensor data, we employ a manifold regularization term for the core tensors constructed in the Tucker decomposition. An algorithm called manifold regularization NTD (MR-NTD) is developed to solve the common projection matrices and core tensors in an alternating least squares manner. The convergence of the proposed algorithm is shown, and the computational complexity of the proposed method scales linearly with respect to the number of tensor objects and the size of the tensor objects, respectively. These theoretical results show that the proposed algorithm can be efficient. Extensive experimental results have been provided to further demonstrate the effectiveness and efficiency of the proposed MR-NTD algorithm.Keywords
This publication has 50 references indexed in Scilit:
- Image representation using Laplacian regularized nonnegative tensor factorizationPattern Recognition, 2011
- A survey of multilinear subspace learning for tensor dataPattern Recognition, 2011
- Tensor decompositions for feature extraction and classification of high dimensional datasetsNonlinear Theory and Its Applications, IEICE, 2010
- 3D face detection using curvature analysisPattern Recognition, 2006
- Parallel Factor Analysis as an exploratory tool for wavelet transformed event-related EEGNeuroImage, 2006
- Principal Component Analysis2005
- Decomposing EEG data into space–time–frequency components using Parallel Factor AnalysisNeuroImage, 2004
- Two-dimensional pca: a new approach to appearance-based face representation and recognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- A Global Geometric Framework for Nonlinear Dimensionality ReductionScience, 2000
- Numerical methods for computing angles between linear subspacesMathematics of Computation, 1973