Hybrid DRL-Based Uplink BS Selection and Power Control for Mobility Management in FD-RAN
- 9 April 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cognitive Communications and Networking
- Vol. 12, 7231-7245
Abstract
Immersive communication in sixth-generation mobile networks (6G) demands ultra-high data rates, seamless connectivity, and consistent service quality, posing stringent requirements on mobility management in dynamic environments. Fully-decoupled radio access network (FD-RAN), as a promising 6G architecture, supports decoupled uplink/downlink access and multi-base-station cooperation, enabling uplink-intensive multi-connectivity mobility management. Realizing this capability in FD-RAN entails joint optimization of uplink base station (UBS) selection and user equipment (UE) power control, which is inherently challenging due to their mixed-variable nature. In this paper, we investigate the uplink mobility management problem in FD-RAN by formulating it as a mixed-variable optimization that minimizes the mismatch between network serving capability and dynamic QoS demands. To solve this efficiently, we propose a hybrid-action-space deep reinforcement learning (HDRL) framework and further design a dimension-reduced discrete action space to improve training efficiency. Based on the HDRL framework, we develop a hybrid proximal policy optimization (HPPO) algorithm with two independent sub-actors for discrete UBS association and continuous power control, jointly trained via a shared global critic. Simulation results validate the effectiveness of the HPPO algorithm in enabling seamless and demand-aware uplink services for mobile UEs.Keywords
Funding Information
- National Natural Science Foundation of China (62271244)
- Jiangsu Province Innovation and Entrepreneurship Team Project (JSSCTD202202)
This publication has 37 references indexed in Scilit:
- Joint User Association and Power Control for Cell-Free Massive MIMOIEEE Internet of Things Journal, 2024
- Action decoupled SAC reinforcement learning with discrete-continuous hybrid action spacesNeurocomputing, 2023
- Two-Timescale Learning-Based Task Offloading for Remote IoT in Integrated Satellite–Terrestrial NetworksIEEE Internet of Things Journal, 2023
- Federated Learning Over Fully-Decoupled RAN Architecture for Two-Tier Computing AccelerationIEEE Journal on Selected Areas in Communications, 2023
- Applications of Multi-Agent Reinforcement Learning in Future Internet: A Comprehensive SurveyIEEE Communications Surveys & Tutorials, 2022
- Multiple Access in Cell-Free Networks: Outage Performance, Dynamic Clustering, and Deep Reinforcement Learning-Based DesignIEEE Journal on Selected Areas in Communications, 2020
- Exploiting Deep Learning in Limited-Fronthaul Cell-Free Massive MIMO UplinkIEEE Journal on Selected Areas in Communications, 2020
- Fundamentals of Mobility-Aware Performance Characterization of Cellular Networks: A TutorialIEEE Communications Surveys & Tutorials, 2019
- Massive MIMO with imperfect channel covariance information2016
- Fundamentals of Wireless Communication2005