Real-Time Data Selection and Merging for 3D-Image Sensing Network With Multiple Sensors
- 5 August 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 21 (19) , 22058-22076
Abstract
Acquiring high quality 3D-image data in real time from multiple 3D-image sensors is problematic because of the following three difficulties: 1) latency, 2) calibration, and 3) limited network bandwidth. First, the delay from sensing to getting the detection results needs to be within a few hundreds of milliseconds. Second, time calibration and spatial calibration are essential when data are merged from multiple 3D-image sensors. Lastly, due to a large volume of the data from 3D-image sensors, a part of data cannot be delivered under limited bandwidth when data are merged via the network. In this paper, to tackle the difficulties, we propose a scheme for real-time 3D-image sensing with multiple 3D-image sensors. The proposed scheme consists of a data selection method to cut down the data volume while suppressing computational complexity, and a data merging method to merge data from multiple 3D-image sensors while satisfying the required periodical deadline. We develop a prototype system to implement the proposed scheme. We measure the processing delay and confirm that the proposed scheme satisfies the delay requirement. We also measure the quality of merged data collected from multiple 3D-image sensors using the proposed scheme, by performing experiments in laboratory and real fields. From the measurement results, we verify that the proposed scheme solves the difficulties; it merges data from multiple 3D-image sensors and maintains high data quality in real time by reducing the data volume against strict bandwidth limitation in both laboratory and real fields.Keywords
Funding Information
- Japan Science and Technology Agency (JST) PRESTO (JPMJPR1854)
- Japan Society for the Promotion of Science (JSPS) KAKENHI, Japan (21H03427, 21H03426)
This publication has 19 references indexed in Scilit:
- Internet of surveillance: a cloud supported large-scale wireless surveillance systemThe Journal of Supercomputing, 2016
- Compression of 3D Point Clouds Using a Region-Adaptive Hierarchical TransformIEEE Transactions on Image Processing, 2016
- A Survey of Vision-Based Traffic Monitoring of Road IntersectionsIEEE Transactions on Intelligent Transportation Systems, 2016
- The Design and Implementation of a Wireless Video Surveillance System2015
- Real-time point cloud compression2015
- Point cloud attribute compression with graph transform2014
- Features Selection for Multi-camera Tracking2014
- Consistent Re-identification in a Camera Network2014
- The Role of Advanced Sensing in Smart CitiesSensors, 2012
- A cloud-assisted design for autonomous driving2012