IoT Data Compression: Sensor-Agnostic Approach
Authors:
- Soma BandyopadhyaySBSoma Bandyopadhyay
- Arpan PalAPArpan Pal
- 1 April 2015
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10680314,p. 303-312
Abstract
Management of bulk sensor data is one of the challenging problems in the development of Internet of Things (IoT) applications. High volume of sensor data induces for optimal implementation of appropriate sensor data compression technique to deal with the problem of energy-efficient transmission, storage space optimization for tiny sensor devices, and cost-effective sensor analytics. The compression performance to realize significant gain in processing high volume sensor data cannot be attained by conventional lossy compression methods, which are less likely to exploit the intrinsic unique contextual characteristics of sensor data. In this paper, we propose SensCompr, a dynamic lossy compression method specific for sensor datasets and it is easily realizable with standard compression methods. Senscompr leverages robust statistical and information theoretic techniques and does not require specific physical modeling. It is an information-centric approach that exhaustively analyzes the inherent properties of sensor data for extracting the embedded useful information content and accordingly adapts the parameters of compression scheme to maximize compression gain while optimizing information loss. Senscompr is successfully applied to compress large sets of heterogeneous real sensor datasets like ECG, EEG, smart meter, accelerometer. To the best of our knowledge, for the first time 'sensor information content'-centric dynamic compression technique is proposed and implemented particularly for IoT-applications and this method is independent to sensor data types.Keywords
This publication has 12 references indexed in Scilit:
- Gait based people identification system using multiple switching kinects2013
- Compressed sensing under matrix uncertainty: Optimum thresholds and robust approximate message passing2013
- An Evaluation of Model-Based Approaches to Sensor Data CompressionIEEE Transactions on Knowledge and Data Engineering, 2012
- Distributed Scalar Quantization for Computing: High-Resolution Analysis and ExtensionsIEEE Transactions on Information Theory, 2011
- R peak detection in electrocardiogram signal based on an optimal combination of wavelet transform, Hilbert transform, and adaptive thresholdingJournal of Medical Signals & Sensors, 2011
- ECG Anomaly Detection via Time Series Analysis2007
- On-line outlier detection and data cleaningComputers & Chemical Engineering, 2004
- The impact of the MIT-BIH Arrhythmia DatabaseIEEE Engineering in Medicine and Biology Magazine, 2001
- The Identification of Multiple OutliersJournal of the American Statistical Association, 1993
- Percentage Points for a Generalized ESD Many-Outlier ProcedureTechnometrics, 1983