H-PARAFAC: Hierarchical Parallel Factor Analysis of Multidimensional Big Data
- 26 September 2016
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Parallel and Distributed Systems
- Vol. 28 (4) , 1091-1104
Abstract
It has long been an important issue in various disciplines to examine massive multidimensional data superimposed by a high level of noises and interferences by extracting the embedded multi-way factors. With the quick increases of data scales and dimensions in the big data era, research challenges arise in order to (1) reflect the dynamics of large tensors while introducing no significant distortions in the factorization procedure and (2) handle influences of the noises in sophisticated applications. A hierarchical parallel processing framework over a GPU cluster, namely H-PARAFAC, has been developed to enable scalable factorization of large tensors upon a “divide-and-conquer” theory for Parallel Factor Analysis (PARAFAC). The H-PARAFAC framework incorporates a coarse-grained model for coordinating the processing of sub-tensors and a fine-grained parallel model for computing each sub-tensor and fusing sub-factors. Experimental results indicate that (1) the proposed method breaks the limitation on the scale of multidimensional data to be factorized and dramatically outperforms the traditional counterparts in terms of both scalability and efficiency, e.g., the runtime increases in the order of n2 when the data volume increases in the order of n3, (2) H-PARAFAC has potentials in refraining the influences of significant noises, and (3) H-PARAFAC is far superior to the conventional window-based counterparts in preserving the features of multiple modes of large tensors.Keywords
Funding Information
- National Natural Science Foundation of China (61273063, 61272314, 81230023, 61671332)
- National Social Science Foundation (16BSH107)
- Fundamental Research Funds for the Central Universities (2042015KF1009, 211410100028)
- Science and Technology Supporting Program in Hubei province (2015BAA113)
- Excellent Youth Foundation of Hubei Scientific Committee (2012FFA025)
- Major Achievements Transformation Projects for the Central Universities in Beijing
This publication has 32 references indexed in Scilit:
- Link the remote sensing big data to the image features via wavelet transformationCluster Computing, 2016
- Tensor decomposition of EEG signals: A brief reviewJournal of Neuroscience Methods, 2015
- Fast Alternating LS Algorithms for High Order CANDECOMP/PARAFAC Tensor FactorizationsIEEE Transactions on Signal Processing, 2013
- CANDECOMP/PARAFAC Decomposition of High-Order Tensors Through Tensor ReshapingIEEE Transactions on Signal Processing, 2013
- Cramér-Rao-Induced Bounds for CANDECOMP/PARAFAC Tensor DecompositionIEEE Transactions on Signal Processing, 2013
- BENEFITS OF MULTI-DOMAIN FEATURE OF MISMATCH NEGATIVITY EXTRACTED BY NON-NEGATIVE TENSOR FACTORIZATION FROM EEG COLLECTED BY LOW-DENSITY ARRAYInternational Journal of Neural Systems, 2012
- Characteristics of Evoked Potential Multiple EEG Recordings in Patients with Chronic Pain by Means of Parallel Factor AnalysisComputational and Mathematical Methods in Medicine, 2012
- Singular value decomposition on GPU using CUDA2009
- PARAFAC. Tutorial and applicationsChemometrics and Intelligent Laboratory Systems, 1997
- PARAFAC: Parallel factor analysisComputational Statistics & Data Analysis, 1994