Mingjian Fu

The exponential growth of data traffic in 6G drives the dense deployment of small cells. While spectrum reuse enhances capacity, it inevitably exacerbates inter-user and inter-cell interference. Consequently, power allocation is vital for maximizing the instantaneous downlink sum rate subject to transmit power constraints. However, traditional optimization methods, such as fractional programming, rely on global Channel State Information (CSI) and incur high computational complexity, rendering them impractical for dynamic, large scale networks. Although Deep Reinforcement Learning (DRL) offers a promising alternative, existing methods are limited by full CSI dependence, misalignment with instantaneous objectives, and inefficient exploration, hindering robustness in dynamic environments. To address these challenges, this study proposes an enhanced DRL-based power allocation framework termed Information-Gain Deep Deterministic Policy Gradient (IG-DDPG). First, a compact state representation is designed by retaining only the top-I strongest normalized interference channel gains relative to the serving link, while discarding weak and negligible interference sources. This selection rationale effectively preserves dominant interference information to maintain decision accuracy while significantly reducing the state space dimensionality to remove the dependency on global CSI. Second, a max-reward learning mechanism is incorporated into the Deep Deterministic Policy Gradient (DDPG) architecture to directly optimize instantaneous sum rate. Third, building upon the Intrinsic Curiosity Module (ICM), we reinterpret its prediction-error signal as an information-gain surrogate and integrate it as an intrinsic objective. A weighting parameter is introduced to balance the trade-off between the extrinsic instantaneous rate and the intrinsic information gain, guiding the agent toward dynamically informative state transitions. Extensive experiments demonstrate that IG-DDPG consistently outperforms the baseline DDPG algorithm. It improves the average sum rate by no less than 4.3%, increases the top 20% average sum rate by at least 2.4%, and reduces variance by up to 22.15%. These results confirm that IG-DDPG provides a scalable and robust solution for real-time interference management in 6G ultra-dense cellular networks.

In recent years, Unmanned Aerial Vehicles (UAVs) have attracted a lot of attention due to their flexibility and mobility. However, due to the increasingly complex environments faced by UAVs and the rising demands on UAV systems, traditional UAV control methods can no longer efficiently control the UAV under multi-constraint situations. Reinforcement Learning (RL), as an emerging robot control technology, is well suited to the needs of UAV systems in terms of its ability to interact with and learn from the environment. Therefore, RL-based UAV systems are gradually becoming a new trend in research. Nonetheless, as a new research field, it faces some challenges. To fully grasp the landscape of RL-based UAV systems, it is paramount to provide a comprehensive overview and analysis of the existing specific RL methods applied to UAV systems. In this survey, we first provide a comprehensive overview and summary of the application of RL in different UAV scenarios based on the classification of RL methods. After that, based on the existing relevant literature, we conduct a systematic analysis of the challenges and recent advancements when applying RL to UAV systems. Finally, we discuss the potential research directions for RL-based UAV systems.

A fast deblurring network, based on a high-performance convolutional network and pixel volume, is proposed to address the limitations of existing video deblurring algorithms, which often overly emphasize inter-frame information, leading to high algorithmic complexity. First, high-performance convolutional networks are utilized to prune the deblurring network, thereby reducing both the number of model parameters and computational complexity. To address the increased network computational complexity resulting from the extensive use of traditional two-dimensional convolutional layers, depthwise over-parameterized convolutions are employed to replace traditional convolutions. This substitution significantly reduces computational complexity without compromising the network’s structure and performance. In addition, the Charbonnier loss function is used to approximate the mean absolute error (MAE) loss function to alleviate the over-smoothing problem. At the same time, the problem of non-differentiability of the MAE loss function at zero is solved by adding a constant, to enhance the visual quality of video images. Experimental results demonstrate that the proposed method delivers superior deblurring performance. Compared with the baseline pixel volume deblurring network framework, our method achieves a significant reduction in model complexity, demonstrating 28.73% fewer parameters and 59.96% lower floating-point operations, underscoring its theoretical significance.