On multilinear principal component analysis of order-two tensors
- 22 May 2012
- journal article
- research article
- Published by Oxford University Press (OUP) in Biometrika
- Vol. 99 (3) , 569-583
Abstract
Principal component analysis is commonly used for dimension reduction in analysing high-dimensional data. Multilinear principal component analysis aims to serve a similar function for analysing tensor structure data, and has empirically been shown effective in reducing dimensionality. In this paper, we investigate its statistical properties and demonstrate its advantages. Conventional principal component analysis, which vectorizes the tensor data, may lead to inefficient and unstable prediction due to the often extremely large dimensionality involved. Multilinear principal component analysis, in trying to preserve the data structure, searches for low-dimensional projections and, thereby, decreases dimensionality more efficiently. The asymptotic theory of order-two multilinear principal component analysis, including asymptotic efficiency and distributions of principal components, associated projections, and the explained variance, is developed. A test of dimensionality is also proposed. Finally, multilinear principal component analysis is shown to improve conventional principal component analysis in analysing the Olivetti faces dataset, which is achieved by extracting a more modularly oriented basis set in reconstructing the test faces.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- On dimension folding of matrix- or array-valued statistical objectsThe Annals of Statistics, 2010
- MPCA: Multilinear Principal Component Analysis of Tensor ObjectsIEEE Transactions on Neural Networks, 2008
- : Two-directional two-dimensional PCA for efficient face representation and recognitionNeurocomputing, 2005
- Generalized Low Rank Approximations of MatricesMachine Learning, 2005
- Two-dimensional pca: a new approach to appearance-based face representation and recognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- A Multilinear Singular Value DecompositionSIAM Journal on Matrix Analysis and Applications, 2000
- On the Best Rank-1 and Rank-(R1 ,R2 ,. . .,RN) Approximation of Higher-Order TensorsSIAM Journal on Matrix Analysis and Applications, 2000
- On the validity of the perturbation method in asymptotic theoryStatistics, 1987
- The Commutation Matrix: Some Properties and ApplicationsThe Annals of Statistics, 1979
- Asymptotic Theory for Principal Component AnalysisThe Annals of Mathematical Statistics, 1963