Parallel Continuous Preference Queries over Out-of-Order and Bursty Data Streams
- 7 March 2017
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Parallel and Distributed Systems
- Vol. 28 (9) , 2608-2624
Abstract
Techniques to handle traffic bursts and out-of-order arrivals are of paramount importance to provide real-time sensor data analytics in domains like traffic surveillance, transportation management, healthcare and security applications. In these systems the amount of raw data coming from sensors must be analyzed by continuous queries that extract value-added information used to make informed decisions in real-time. To perform this task with timing constraints, parallelism must be exploited in the query execution in order to enable the real-time processing on parallel architectures. In this paper we focus on continuous preference queries, a representative class of continuous queries for decision making, and we propose a parallel query model targeting the efficient processing over out-of-order and bursty data streams. We study how to integrate punctuation mechanisms in order to enable out-of-order processing. Then, we present advanced scheduling strategies targeting scenarios with different burstiness levels, parameterized using the index of dispersion quantity. Extensive experiments have been performed using synthetic datasets and real-world data streams obtained from an existing real-time locating system. The experimental evaluation demonstrates the efficiency of our parallel solution and its effectiveness in handling the out-of-orderness degrees and burstiness levels of real-world applications.Keywords
Funding Information
- eu (H2020-ICT-2014-1, 644235)
This publication has 31 references indexed in Scilit:
- Resource management for bursty streams on multi-tenancy cloud environmentsFuture Generation Computer Systems, 2016
- Evaluating the impact of fine-scale burstiness on cloud elasticity2015
- Structured Parallel Programming with “core” FastFlow2015
- Elastic Scaling for Data Stream ProcessingIEEE Transactions on Parallel and Distributed Systems, 2013
- A survey of top- k query processing techniques in relational database systemsACM Computing Surveys, 2008
- How to parameterize models with bursty workloadsACM SIGMETRICS Performance Evaluation Review, 2008
- Out-of-order processingProceedings of the VLDB Endowment, 2008
- No pane, no gainACM SIGMOD Record, 2005
- Exploiting k -constraints to reduce memory overhead in continuous queries over data streamsACM Transactions on Database Systems, 2004
- Exploiting punctuation semantics in continuous data streamsIEEE Transactions on Knowledge and Data Engineering, 2003