Edge-Assisted Real-Time Instance Segmentation for Resource-Limited IoT Devices
- 18 August 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 10 (1) , 473-485
Abstract
Instance segmentation exploits the potential of Internet of Things (IoT) devices to perceive environmental semantic information and achieve complex interactions with the physical world. However, IoT devices usually have limited computing and storage resources and cannot afford the intensive computational costs of instance segmentation networks. This article proposes an edge-assisted instance segmentation method for resource-limited IoT devices; it selectively offloads some computation-intensive tasks from IoT devices to edge servers to accelerate the inference processes of instance segmentation networks. To reduce the communication cost caused by computation offloading, a data compression method is proposed to adaptively adjust the downsampling interval based on an attention mechanism. Considering the susceptibility of the computation offloading scheme to network conditions, an adaptive computation offloading strategy that can jointly optimize the offloading point and the data compression ratio is proposed so that the edge-assisted instance segmentation can meet the preset latency requirements while achieving maximal accuracy under volatile network conditions. Extensive experiments are conducted to verify the feasibility and efficiency of our method. The experimental results show that our method induces less latency than existing instance segmentation methods with a slight drop in accuracy.Keywords
Funding Information
- Basic and Applied Basic Research Foundation of Guangdong Province (2020A1515110463)
- Fundamental Research Funds for the Central Universities (FRF-TP-20-063A1Z, FRF-IDRY-20-018)
- Ministry of Education of the People’s Republic of China Overseas Distinguished Professorship (MS2017BJKJ003)
This publication has 39 references indexed in Scilit:
- Mask R-CNN2017
- Fully Convolutional Instance-Aware Semantic Segmentation2017
- Residual Attention Network for Image Classification2017
- You Only Look Once: Unified, Real-Time Object Detection2016
- Learning Deconvolution Network for Semantic Segmentation2015
- Accelerating Very Deep Convolutional Networks for Classification and DetectionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Glimpse2015
- Caffe2014
- Microsoft COCO: Common Objects in Context2014
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998