SurveilEdge: Real-time Video Query based on Collaborative Cloud-Edge Deep Learning
Authors:
- 1 July 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2519-2528
Abstract
The real-time query of massive surveillance video data plays a fundamental role in various smart urban applications such as public safety and intelligent transportation. Traditional cloud-based approaches are not applicable because of high transmission latency and prohibitive bandwidth cost, while edge devices are often incapable of executing complex vision algorithms with low latency and high accuracy due to restricted resources. Given the infeasibility of both cloud-only and edge-only solutions, we present SurveilEdge, a collaborative cloud-edge system for real-time queries of large-scale surveillance video streams. Specifically, we design a convolutional neural network (CNN) training scheme to reduce the training time with high accuracy, and an intelligent task allocator to balance the load among different computing nodes and to achieve the latency-accuracy tradeoff for real-time queries. We implement SurveilEdge on a prototype 1 with multiple edge devices and a public Cloud, and conduct extensive experiments using real-world surveillance video datasets. Evaluation results demonstrate that SurveilEdge manages to achieve up to 7× less bandwidth cost and 5.4× faster query response time than the cloud-only solution; and can improve query accuracy by up to 43.9% and achieve 15.8× speedup respectively, in comparison with edge-only approaches.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- Real-Time Video Analytics: The Killer App for Edge ComputingComputer, 2017
- NoScopeProceedings of the VLDB Endowment, 2017
- The Emergence of Edge ComputingComputer, 2017
- Deep Residual Learning for Image Recognition2016
- Deep learningNature, 2015
- Vehicle detection and recognition for intelligent traffic surveillance systemMultimedia Tools and Applications, 2015
- scikit-image: image processing in PythonPeerJ, 2014
- Smart city and the applications2011
- Framework for Real-Time Behavior Interpretation From Traffic VideoIEEE Transactions on Intelligent Transportation Systems, 2005
- Topological structural analysis of digitized binary images by border followingComputer Vision, Graphics, and Image Processing, 1985