Abstract
Deploying large deep neural networks (DNNs) on resource-constrained Internet of Things (IoT) devices is often limited by high inference latency and energy consumption. This article studies collaborative inference between user devices and edge servers (ESs), where a deep neural network (DNN) is partitioned and executed across both sides under shared wireless resources. We jointly optimize the partition point across layers, uplink channel allocation and transmission power control, and formulate the coupled decisions as a Markov decision process (MDP). Under centralized training with decentralized execution (CTDE), we develop a multiagent proximal policy optimization (MAPPO) framework with a multihead critic and profiling-aware state design to stabilize learning under large hybrid action spaces. To validate practicality, we implement a containerized experimental platform that emulates resource-limited IoT devices and GPU-enabled ESs, enabling repeatable measurements of end-to-end latency and energy. Experiments with representative DNNs show that the proposed method consistently improves the latency–energy tradeoff over baseline algorithms, achieving lower end-to-end latency and comparable or lower energy consumption across diverse model structures and computation patterns.
Funding Information
  • National Natural Science Foundation of China (61202076)
  • Beijing Municipal Natural Science Foundation (4262021)
  • Fundamental Research Funds for the Central Universities (312000546325001)

This publication has 38 references indexed in Scilit: