Shoggoth: Towards Efficient Edge-Cloud Collaborative Real-Time Video Inference via Adaptive Online Learning
Authors:
- 9 July 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Abstract
This paper proposes Shoggoth, an efficient edge-cloud collaborative architecture, for boosting inference performance on real-time video of changing scenes. Shoggoth uses online knowledge distillation to improve the accuracy of models suffering from data drift and offloads the labeling process to the cloud, alleviating constrained resources of edge devices. At the edge, we design adaptive training using small batches to adapt models under limited computing power, and adaptive sampling of training frames for robustness and reducing bandwidth. The evaluations on the realistic dataset show 15%–20% model accuracy improvement compared to the edge-only strategy and fewer network costs than the cloud-only strategy.Keywords
Funding Information
- Research and Development
- National Natural Science Foundation of China
This publication has 18 references indexed in Scilit:
- Clownfish: Edge and Cloud Symbiosis for Video Stream Analytics2020
- Latent Replay for Real-Time Continual Learning2020
- Scalability in Perception for Autonomous Driving: Waymo Open Dataset2020
- UA-DETRAC: A new benchmark and protocol for multi-object detection and trackingComputer Vision and Image Understanding, 2020
- Continuous learning in single-incremental-task scenariosNeural Networks, 2019
- Large-Scale Long-Tailed Recognition in an Open World2019
- NoScopeProceedings of the VLDB Endowment, 2017
- Deep Residual Learning for Image Recognition2016
- Vision meets robotics: The KITTI datasetThe International Journal of Robotics Research, 2013
- Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem1989