Long Gaps Missing IoT Sensors Time Series Data Imputation: A Bayesian Gaussian Approach
Open Access
- 1 November 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 116107-116119
Abstract
Missing sensor data is a common problem associated with the Internet of Things (IoT) ecosystems, which affect the accuracy of the associated services such as adequate medical intervention for older adults living at home. This problem is caused by many factors, power down is one of them, communication failure and sensor failure are another two reasons. Multiple missing data imputation methods have been developed to solve this issue. However, irregular temporal missing data locations is challenging to handle, due to lack of knowledge of their occurrence probability and their random temporal location. In this paper, we propose a Bayesian Gaussian Process based imputation technique that accounts for temporal forcing to fill in the missing sensor data. Our approach; Bayesian Gaussian Process (BGaP); can impute missing data efficiently at any missing rate and for any temporal location using prior knowledge gathered on past observations. We illustrated how our approach performs using real data collected from sensors deployed in the residence of 10 older adults over a two-year period. Using our novel approach, we were able to impute all the missing data which allowed us to observe long-term behavior changes that we would not have been able to observe otherwise.Keywords
This publication has 26 references indexed in Scilit:
- Internet of Things: A Survey on Enabling Technologies, Protocols, and ApplicationsIEEE Communications Surveys & Tutorials, 2015
- A Guide to Handling Missing Data in Cost-Effectiveness Analysis Conducted Within Randomised Controlled TrialsPharmacoEconomics, 2014
- Principled missing data methods for researchersSpringerPlus, 2013
- The Internet of Things: A Survey from the Data-Centric Perspective2012
- Real-time information processing of environmental sensor network data using bayesian gaussian processesACM Transactions on Sensor Networks, 2012
- Multiple imputation using chained equations: Issues and guidance for practiceStatistics in Medicine, 2010
- Dynamic linear models2009
- Much Ado About NothingThe American Statistician, 2007
- How can I deal with missing data in my study?Australian and New Zealand Journal of Public Health, 2001
- Inference and missing dataBiometrika, 1976