DR-TSP: A Data Repairing Framework for Time Synchronization Problems in ERI Data
- 11 February 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 8 (14) , 11666-11677
Abstract
Timestamps are often problematic in Internet-of-Things (IoT) systems due to time synchronization problems of distributed radio-frequency identification (RFID) readers or sensors. This issue may seriously affect the data quality in some fields, such as transportation. A typical IoT application in transportation is electronic registration identification of the motor vehicle (ERI), an emerging traffic data acquisition technology based on RFID. ERI data play a vital role in intelligent transportation. However, the data quality is often affected seriously by the inaccurate timestamps, which arise from the time-unsynchronized distributed ERI readers. To solve this issue, we propose a novel framework, data repairing of time synchronization problems (DR-TSP), which can detect the time-unsynchronized ERI readers and correct timestamp-deviated ERI data. Precisely, DR-TSP consists of three components. Problem reader discovery component employs a statistics-based method to detect the time-unsynchronized ERI readers and discovers the clock leaps of the problematic ERI reader through a smoothing-based method. Travel-time estimation component constructs a spatial correlative travel-time estimation model based on the neural network to infer timestamp deviation. The influence of clock deviation is considered in the model training. Data correction component utilizes the above results to correct the timestamp-deviated data. Experiments over large-scale ERI data collected from a big China city, Chongqing, show that our method can significantly improve data quality.Keywords
Funding Information
- National Key Research and Development Program of China (2017YFC0212103)
- Key Research and Development Program of Chongqing (cstc2018jszx-cyztzxX0019)
- Ford University Research Program (DEPT2018-J030.1)
This publication has 35 references indexed in Scilit:
- Outlier detection in traffic data based on the Dirichlet process mixture modelIET Intelligent Transport Systems, 2015
- Survey on time synchronization technology in networks2015
- An Outlier Detect Algorithm using Big Data Processing and Internet of Things ArchitectureProcedia Computer Science, 2015
- Synchronization Protocols and Implementation Issues in Wireless Sensor Networks: A ReviewIEEE Systems Journal, 2014
- A Vision of IoT: Applications, Challenges, and Opportunities With China PerspectiveIEEE Internet of Things Journal, 2014
- Short-term traffic forecasting: Where we are and where we’re goingTransportation Research Part C: Emerging Technologies, 2014
- Dynamic travel time prediction using data clustering and genetic programmingTransportation Research Part C: Emerging Technologies, 2014
- Outlier Detection for Temporal Data: A SurveyIEEE Transactions on Knowledge and Data Engineering, 2013
- Anomaly detection in streaming environmental sensor data: A data-driven modeling approachEnvironmental Modelling & Software, 2010
- Declarative Support for Sensor Data Cleaning2006