Toward a Virtual Edge Service Provider: Actor-Critic Learning to Incentivize the Computation Nodes
- 26 June 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Network Science and Engineering
- Vol. 11 (1) , 24-38
Abstract
The growing development of computation-intensive applications has considerably increased the demand for computing resources in the network. Many of these applications require computations with low delays. Edge computing, which offers computing resources at the edge of the network, is a prominent solution. However, an edge service provider might not have sufficient resources at the edge to satisfy the demands of its users. Computation offloading can fill the gap by letting the service provider transfer the users' computational tasks to other computation nodes (CNs). Nevertheless, due to the imposed costs, CNs are not always interested in sharing their computation capacity. This article considers the concept of a virtual edge service provider, and studies an incentive mechanism to motivate the CNs to share their resources. We formulate the problem as a Stackelberg game and present a complete information analysis. We prove the existence and uniqueness of the game equilibriums. However, the complete information scenario is not accessible in practice due to privacy reasons. Therefore, we propose a soft actor-critic algorithm as an incomplete information method using deep reinforcement learning. Finally, through extensive numerical evaluations, we show that the incomplete information method converges to the same equilibrium that the complete information analysis proved.Keywords
Funding Information
- Institute for Research in Fundamental Sciences (CS 1402-4-208)
- National Natural Science Foundation of China (62071230)
- MOE Tier 1 (RG87/22)
- National Research Foundation
- Singapore and Infocomm Media Development Authority
- Future Communications Research Development Programme
- DSO National Laboratories (AISG2-RP-2020-019)
- Energy Research Test-Bed and Industry Partnership Funding Initiative
- Energy Grid (EG) 2.0 programme
- DesCartes and the Campus for Research Excellence and Technological Enterprise (CREATE) programme
This publication has 37 references indexed in Scilit:
- Computation Offloading Toward Edge ComputingProceedings of the IEEE, 2019
- Profit Maximization Incentive Mechanism for Resource Providers in Mobile Edge ComputingIEEE Transactions on Services Computing, 2019
- A Survey on Mobile Edge Computing: The Communication PerspectiveIEEE Communications Surveys & Tutorials, 2017
- Holographic near-eye displays for virtual and augmented realityACM Transactions on Graphics, 2017
- Offloading in HCNs: Congestion-Aware Network Selection and User Incentive DesignIEEE Transactions on Wireless Communications, 2017
- An Incentive Framework for Mobile Data Offloading Market Under Price CompetitionIEEE Transactions on Mobile Computing, 2017
- Incentive mechanism design for mobile data offloading in heterogeneous networks2015
- Mobile data offloading through a third-party WiFi access point: An operator's perspective2013
- An Incentive Framework for Cellular Traffic OffloadingIEEE Transactions on Mobile Computing, 2013
- Existence and Uniqueness of Equilibrium Points for Concave N-Person GamesEconometrica, 1965