Device Data Ingestion for Industrial Big Data Platforms with a Case Study
Open Access
Abstract
Despite having played a significant role in the Industry 4.0 era, the Internet of Things is currently faced with the challenge of how to ingest large-scale heterogeneous and multi-type device data. In response to this problem we present a heterogeneous device data ingestion model for an industrial big data platform. The model includes device templates and four strategies for data synchronization, data slicing, data splitting and data indexing, respectively. We can ingest device data from multiple sources with this heterogeneous device data ingestion model, which has been verified on our industrial big data platform. In addition, we present a case study on device data-based scenario analysis of industrial big data.Keywords
Funding Information
- National Natural Science Foundation of China (61402263)
- National High Technology Research and Development Program of China (2014AA01A302)
- Independent Innovation Projects of Shandong Province (2013CXC30209)
- Science & Technology Development Projects of Shandong Province (2014GGX101028)
This publication has 19 references indexed in Scilit:
- A Novel Scheme for an Energy Efficient Internet of Things Based on Wireless Sensor NetworksSensors, 2015
- A Self-Assessment Stereo Capture Model Applicable to the Internet of ThingsSensors, 2015
- Streaming Big Data Processing in Datacenter CloudsIEEE Cloud Computing, 2014
- Mining big dataACM SIGKDD Explorations Newsletter, 2013
- A peer-to-peer collaboration framework for multi-sensor data fusionJournal of Network and Computer Applications, 2012
- Agencies Rally to Tackle Big DataScience, 2012
- Early classification on time seriesKnowledge and Information Systems, 2011
- A view of cloud computingCommunications of the ACM, 2010
- Community cleverness requiredNature, 2008
- Dimensionality Reduction for Fast Similarity Search in Large Time Series DatabasesKnowledge and Information Systems, 2001