Privacy-Aware Joint DNN Model Deployment and Partition Optimization for Delay-Efficient Collaborative Edge Inference
Authors:
- Zhipeng ChengZCZhipeng Cheng
- Xiaoyu XiaXXXiaoyu Xia
- Hong WangHWHong Wang
- Minghui LiwangMinghui Liwang
- Ning ChenNCNing Chen
- Xuwei FanXFXuwei Fan
- Xianbin WangXianbin Wang
Preprint
Abstract
Edge inference (EI) is a key solution to address the growing challenges of delayed response times, limited scalability, and privacy concerns in cloud-based Deep Neural Network (DNN) inference. However, deploying DNN models on resource-constrained edge devices faces more severe challenges, such as model storage limitations, dynamic service requests, and privacy risks. This paper proposes a novel framework for privacy-aware joint DNN model deployment and partition optimization to minimize long-term average inference delay under resource and privacy constraints. Specifically, the problem is formulated as a complex optimization problem considering model deployment, user-server association, and model partition strategies. To handle the NP-hardness and future uncertainties, a Lyapunov-based approach is introduced to transform the long-term optimization into a single-time-slot problem, ensuring system performance. Additionally, a coalition formation game model is proposed for edge server association, and a greedy-based algorithm is developed for model deployment within each coalition to efficiently solve the problem. Extensive simulations show that the proposed algorithms effectively reduce inference delay while satisfying privacy constraints, outperforming baseline approaches in various scenarios.Keywords
All Related Versions
This publication has 28 references indexed in Scilit:
- Energy-optimal DNN model placement in UAV-enabled edge computing networksDigital Communications and Networks, 2024
- Privacy‐preserving model splitting and quality‐aware device association for federated edge learningSoftware: Practice and Experience, 2023
- A Survey on Collaborative DNN Inference for Edge IntelligenceMachine Intelligence Research, 2023
- Joint multi-user DNN partitioning and task offloading in mobile edge computingAd Hoc Networks, 2023
- MPDM: A Multi-Paradigm Deployment Model for Large-Scale Edge-Cloud IntelligenceIEEE Internet of Things Journal, 2022
- Efficient Acceleration of Deep Learning Inference on Resource-Constrained Edge Devices: A ReviewProceedings of the IEEE, 2022
- Collaborative Inference for AI-Empowered IoT DevicesIEEE Internet of Things Magazine, 2022
- Design possibilities and challenges of DNN models: a review on the perspective of end devicesArtificial Intelligence Review, 2022
- Attacking and Protecting Data Privacy in Edge–Cloud Collaborative Inference SystemsIEEE Internet of Things Journal, 2020
- Scaling for edge inference of deep neural networksNature Electronics, 2018