Tensor Deep Learning Model for Heterogeneous Data Fusion in Internet of Things
- 5 November 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Emerging Topics in Computational Intelligence
- Vol. 4 (1) , 32-41
Abstract
With the rapid evolvement of the Internet and data acquisition technology as well as the continuous advancement of science and technology, the amount of data in many fields has reached the level of terabyte or petabyte and most data collection comes from the Internet of Things (IoT). The rapid advancement of IoT big data has provided valuable opportunities for the development of people in all areas of society. At the same time, it has also brought severe challenges to various types of current information processing systems. Effectively using the big data technology, discovering the hidden laws in big data, tapping the potential value of big data, and predicting the development trend of things to allocate resources more reasonably will promote the overall development of society. However, most of the IoT big data are presented as heterogeneous data, with high dimensions, different forms of expression, and a lot of redundant information. The current machine learning model works in vector space, which makes it impossible to gain big data features because vectors cannot simulate the highly nonlinear distribution of IoT big data. This paper presents a deep learning calculation model called tensor deep learning (TDL), which further improves big data feature learning and high-level feature fusion. It uses tensors to model the complexity of multisource heterogeneous data and extends the vector space data to the tensor space, when feature extraction in the tensor space is included. To fully understand the underlying data distribution, the tensor distance is adopted as the average square sum error term of the output layer reconstruction error. Based on the conventional back-propagation algorithm, this study proposes a high-order back-propagation algorithm to extend the data from the linear space to multiple linear space and train the parameters of the proposed model. Then, to evaluate its performance, the proposed TDL model is compared with the stacked auto encoder and the multimodal deep learning model. Furthermore, experiments are performed on two representative datasets, namely CUAVE and STL-10. Experimental results show that the proposed model not only excels in heterogeneous data fusion but also provides a higher recognition accuracy than the conventional deep learning model or the multimodal learning model for big data.Keywords
Funding Information
- Natural Youth Science Foundation of China (61501326, 61401310)
- National Natural Science Foundation of China (61731006)
- National Natural Science Foundation of China (61271411)
- Tianjin Research Program of Application Foundation and Advanced Technology (15JCZDJC31500)
- Tianjin Science Foundation (16JCYBJC16500)
- Tianjin Higher Education Creative Team Funds Program
This publication has 19 references indexed in Scilit:
- Solving Multilinear Systems via Tensor InversionSIAM Journal on Matrix Analysis and Applications, 2013
- A Curvature Tensor Distance for Mesh Visual Quality AssessmentLecture Notes in Computer Science, 2012
- Multimodal fusion for multimedia analysis: a surveyMultimedia Systems, 2010
- Tensor Decompositions and ApplicationsSIAM Review, 2009
- A Novel Intrusion Detection Model Based on Multi-layer Self-Organizing Maps and Principal Component Analysis2006
- Multilinear Analysis of Image Ensembles: TensorFaces2002
- On the Best Rank-1 and Rank-(R1 ,R2 ,. . .,RN) Approximation of Higher-Order TensorsSIAM Journal on Matrix Analysis and Applications, 2000
- Selection of the Number of Principal Components: The Variance of the Reconstruction Error Criterion with a Comparison to Other MethodsIndustrial & Engineering Chemistry Research, 1999
- Principal component analysisChemometrics and Intelligent Laboratory Systems, 1987
- Learning representations by back-propagating errorsNature, 1986