A Deep RL Approach on Task Placement and Scaling of Edge Resources for Cellular Vehicle-to-Network Service Provisioning
Preprint
Abstract
Cellular-Vehicle-to-Everything (C-V2X) is currently at the forefront of the digital transformation of our society. By enabling vehicles to communicate with each other and with the traffic environment using cellular networks, we redefine transportation, improving road safety and transportation services, increasing efficiency of traffic flows, and reducing environmental impact. This paper proposes a decentralized approach for provisioning Cellular Vehicular-to-Network (C-V2N) services, addressing the coupled problems of service task placement and scaling of edge resources. We formalize the joint problem and prove its complexity. We propose an approach to tackle it, linking the two problems, employing decentralized decision-making using (i) a greedy approach for task placement and (ii) a Deep Deterministic Policy Gradient (DDPG) based approach for scaling. We benchmark the performance of our approach, focusing on the scaling agent, against several State-of-the-Art (SoA) scaling approaches via simulations using a real C-V2N traffic data set. The results show that DDPG-based solutions outperform SoA solutions, keeping the latency experienced by the C-V2N service below the target delay while optimizing the use of computing resources. By conducting a complexity analysis, we prove that DDPG-based solutions achieve runtimes in the range of sub-milliseconds, meeting the strict latency requirements of C-V2N services.Keywords
All Related Versions
This publication has 25 references indexed in Scilit:
- Multi-objective Optimization Service Function Chain Placement Algorithm Based on Reinforcement LearningJournal of Network and Systems Management, 2022
- Dimensioning V2N Services in 5G Networks Through Forecast-Based ScalingIEEE Access, 2022
- A Survey on Task Offloading in Multi-access Edge ComputingJournal of Systems Architecture, 2021
- Auto-scaling techniques for IoT-based cloud applications: a reviewCluster Computing, 2021
- A Tutorial on 5G NR V2X CommunicationsIEEE Communications Surveys & Tutorials, 2021
- Orchestrating heterogeneous MEC-based applications for connected vehiclesComputer Networks, 2020
- Deep Reinforcement Learning for Resource Management in Network SlicingIEEE Access, 2018
- Ciw: An open-source discrete event simulation libraryJournal of Simulation, 2018
- LSTM network: a deep learning approach for short‐term traffic forecastIET Intelligent Transport Systems, 2017
- Forecasting time series using a methodology based on autoregressive integrated moving average and genetic programmingKnowledge-Based Systems, 2011