Learning-Based Multitier Split Computing for Efficient Convergence of Communication and Computation
- 25 July 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 11 (20) , 33077-33096
Abstract
With promising benefits of splitting deep neural network (DNN) computation loads to the edge server, split computing has been a novel paradigm achieving high-quality artificial intelligence (AI) services for the energy-constrained user equipments (UEs). To satisfy the service demands of a large number of UEs, traditional edge-UE split computing evolves toward multitier split computing involving the edge and cloud servers with different capabilities, leading to a “complex” optimization involving communication and computation. To tackle this challenge, in this article, we propose a multitier deep reinforcement learning (DRL) decision-making scheme for distributed splitting point selection and computing resource allocation in the three-tier UE-edge-cloud split computing systems. With the proposed scheme, the high-dimensional optimization can be tackled by the UEs and an edge server with different control cycles through performing local decision-making tasks in a sequential manner. Based on the policies updated by the UEs and the edge server in successive stages, the overall performance of split computing can be continuously improved, which is justified through a theoretical convergence performance analysis. Comprehensive simulation studies show that the proposed multitier DRL decision-making scheme outperforms the conventional split computing schemes in terms of the overall latency, inference accuracy, and energy efficiency to practice multitier split computing.Keywords
This publication has 32 references indexed in Scilit:
- Optimum splitting computing for DNN training through next generation smart networks: a multi-tier deep reinforcement learning approachWireless Networks, 2024
- Efficient Communication-Computation Tradeoff for Split Computing: A Multi-Tier Deep Reinforcement Learning Approach2023
- Dynamic Split Computing for Efficient Deep EDGE Intelligence2023
- Multi-Fine-Grained DNNs Partition and Offloading over Fog Computing Networks2023
- Distributed Artificial Intelligence Empowered by End-Edge-Cloud Computing: A SurveyIEEE Communications Surveys & Tutorials, 2022
- Multiagent Reinforcement Learning: Rollout and Policy IterationIEEE/CAA Journal of Automatica Sinica, 2021
- Joint Multiuser DNN Partitioning and Computational Resource Allocation for Collaborative Edge IntelligenceIEEE Internet of Things Journal, 2020
- Distributed Inference Acceleration with Adaptive DNN Partitioning and Offloading2020
- Applications of Deep Reinforcement Learning in Communications and Networking: A SurveyIEEE Communications Surveys & Tutorials, 2019
- Knapsack Problems2004