Building an IoT Platform Based on Service Containerisation
Open Access
Abstract
IoT platforms have become quite complex from a technical viewpoint, becoming the cornerstone for information sharing, storing, and indexing given the unprecedented scale of smart services being available by massive deployments of a large set of data-enabled devices. These platforms rely on structured formats that exploit standard technologies to deal with the gathered data, thus creating the need for carefully designed customised systems that can handle thousands of heterogeneous data sensors/actuators, multiple processing frameworks, and storage solutions. We present the SCoT2.0 platform, a generic-purpose IoT Platform that can acquire, process, and visualise data using methods adequate for both real-time processing and long-term Machine Learning (ML)-based analysis. Our goal is to develop a large-scale system that can be applied to multiple real-world scenarios and is potentially deployable on private clouds for multiple verticals. Our approach relies on extensive service containerisation, and we present the different design choices, technical challenges, and solutions found while building our own IoT platform. We validate this platform supporting two very distinct IoT projects (750 physical devices), and we analyse scaling issues within the platform components.Keywords
Funding Information
- Fundação para a Ciência e a Tecnologia (UIDB/50008/2020-UIDP/50008/2020, PTDC/EEI-TEL/30685/2017)
This publication has 49 references indexed in Scilit:
- An IoT Based Predictive Connected Car Maintenance ApproachInternational Journal of Interactive Multimedia and Artificial Intelligence, 2017
- Open Issues in Scheduling Microservices in the CloudIEEE Cloud Computing, 2016
- IoT-Based Big Data Storage Systems in Cloud Computing: Perspectives and ChallengesIEEE Internet of Things Journal, 2016
- Apache Flink: Stream Analytics at Scale2016
- Scalable semantic aware context storageFuture Generation Computer Systems, 2016
- Study of Various Internet of Things PlatformsInternational Journal of Computer Science & Engineering Survey, 2015
- Data Mining for the Internet of Things: Literature Review and ChallengesInternational Journal of Distributed Sensor Networks, 2015
- Druid2014
- Efficient big data processing in Hadoop MapReduceProceedings of the VLDB Endowment, 2012
- DremelCommunications of the ACM, 2011