Queue Stability-Constrained Deep Reinforcement Learning Algorithms for Adaptive Transmission Control in Multi-Access Edge Computing Systems
Open Access
- 11 August 2025
- journal article
- research article
- Published by MDPI AG in Algorithms
- Vol. 18 (8) , 498
Abstract
To meet the escalating demands of massive data transmission, the next generation of wireless networks will leverage the multi-access edge computing (MEC) architecture coupled with multi-access transmission technologies to enhance communication resource utilization. This paper presents queue stability-constrained reinforcement learning algorithms designed to optimize the transmission control mechanism in MEC systems to improve both throughput and reliability. We propose an analytical framework to model the queue stability. To increase transmission performance while maintaining queue stability, queueing delay model is designed to analyze the packet scheduling process by using the M/M/c queueing model and estimate the expected packet queueing delay. To handle the time-varying network environment, we introduce a queue stability constraint into the reinforcement learning reward function to jointly optimize latency and queue stability. The reinforcement learning algorithm is deployed at the MEC server to reduce the workload of central cloud servers. Simulation results validate that the proposed algorithm effectively controls queueing delay and average queue length while improving packet transmission success rates in dynamic MEC environments.Keywords
This publication has 27 references indexed in Scilit:
- Shapley value-driven multi-modal deep reinforcement learning for complex decision-makingNeural Networks, 2025
- An approximate policy iteration viewpoint of actor–critic algorithmsAutomatica, 2025
- Deep reinforcement learning based proximal policy optimization algorithm for dynamic job shop schedulingComputers & Operations Research, 2025
- Load-balanced offloading of multiple task types for mobile edge computing in IoTInternet of Things, 2024
- An Adaptive Contention Window using Actor-Critic Reinforcement Learning Algorithm for Vehicular Ad-hoc NETworksProcedia Computer Science, 2024
- Lyapunov-guided deep reinforcement learning for delay-aware online task offloading in MEC systemsJournal of Systems Architecture, 2024
- Analytical modelling of a vehicular ad hoc network using queueing theory models and the notion of channel availabilityAEU - International Journal of Electronics and Communications, 2023
- Multi-agent DRL for joint completion delay and energy consumption with queuing theory in MEC-based IIoTJournal of Parallel and Distributed Computing, 2023
- Resource allocation for MEC system with multi-users resource competition based on deep reinforcement learning approachComputer Networks, 2022
- Resource Allocation Algorithm With Multi-Platform Intelligent Offloading in D2D-Enabled Vehicular NetworksIEEE Access, 2019