HiSO-CoMA: Hierarchical Self-Optimizing Framework for O-RAN Slicing Using Cooperative Multiple Agent Deep Reinforcement Learning
Open Access
- 12 November 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Open Journal of the Communications Society
- Vol. 6, 9632-9653
Abstract
Network slicing (NS) is a cornerstone technology for sixth-generation (6G) networks, enabling the support of heterogeneous services with diverse quality-of-service (QoS) requirements. However, existing radio access network (RAN) slicing schemes often rely on single-level resource allocation, limiting their adaptability to the dynamic nature of RAN and the efficient use of limited radio resources. This leads to challenges in satisfying service-level agreements (SLAs). Moreover, effective hierarchical slicing that operates under fluctuating traffic loads, and hardware impairments for multiple antenna systems remains a challenge. To address these issues, we propose a hierarchical self-optimization framework aimed at maximizing both the long-term QoS and the spectral efficiency. Specifically, the proposed framework consists of two slicing management schemes: a cooperative multiple actor-critic (CoMA2C) scheme to manage the power and bandwidth among heterogeneous slices on a large scale. Concurrently, a multiagent deep Q-network (MADQN) scheme manages the power and beamforming for active users within each slice on a small time scale, accounting for hardware impairments, user mobility, traffic fluctuations, and channel variations. The DQN and A2C algorithms are employed in the design of the proposed schemes owing to their proven effectiveness in real-time decision-making in dynamic environments. Furthermore, a promising scheme based on rate-splitting multiple access (RSMA) is investigated for heterogeneous services. Simulation results showcase the effectiveness of our proposed framework, demonstrating its ability to satisfy SLAs for heterogeneous services while reducing network overhead and outperforming existing state-of-the-art approaches.Keywords
Funding Information
- Natural Sciences and Engineering Research Council of Canada (RGPIN-2021-04013)
This publication has 44 references indexed in Scilit:
- AI Based Resource Management for 5G Network Slicing: History, Use Cases, and Research DirectionsConcurrency and Computation: Practice and Experience, 2024
- Task offloading scheme of vehicular cloud edge computing based on Digital Twin and improved A3CInternet of Things, 2024
- RAN Intelligent Controller (RIC): From open-source implementation to real-world validationICT Express, 2024
- Toward an Efficient and Dynamic Allocation of Radio Access Network Slicing Resources for 5G EraIEEE Access, 2023
- Deep Reinforcement Learning Based Resource Allocation for Network Slicing With Massive MIMOIEEE Access, 2023
- A2C Learning for Tasks Segmentation with Cooperative Computing in Edge Computing Networks2022
- Rate-Splitting Multiple Access: Fundamentals, Survey, and Future Research TrendsIEEE Communications Surveys & Tutorials, 2022
- Call Admission Control Optimization in 5G in Downlink Single-Cell MISO SystemProcedia Computer Science, 2021
- Incorporating URLLC and Multicast eMBB in Sliced Cloud Radio Access Network2019
- A Novel Massive MIMO Precoding Scheme for Next Generation Heterogeneous Networks2015