RHRuixuan Han

Ruixuan Han

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Ruixuan Han has a total of 5 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Intelligent Spectrum and Airspace Resource Management for Urban Air Mobility Using Deep Reinforcement Learning

    by Rafael D. Apaza, Ruixuan Han, Hongxiang Li, Eric J. Knoblock

    In an era dominated by a surge in air travel and heightened reliance on efficient communication systems, there’s a critical need to smartly allocate frequency resources for aviation communications to efficiently manage airspace operations. This is essential to ensure safe, smooth, and technologically advanced flight services. Over time, techniques for managing frequency resources and new radio technologies have evolved to cope with the increased demands on the system due to growing airspace activities. With the development of Urban Air Mobility (UAM) operations, a fresh challenge has emerged, further burdening the already limited aviation spectrum. There is a pressing need for a new approach to efficiently manage and utilize frequencies. This paper explores the application of Multi-agent Reinforcement Learning (MARL) technique to minimize aircraft mission completion time and enhance safety, all while dealing with the limitations of airspace and frequency resources. The proposed MARL approach utilizes the value decomposition network (VDN) technique to optimize frequency use, flight time, and departure wait times by managing spectrum allocation, vehicle departure, and flight speed. To achieve the goal of minimizing mission completion time, the Markov Decision Process (MDP) is utilized. It takes into account factors like frequency channel availability, signal-to-interference-plus-noise power ratio, aircraft location, and flight status. In our investigation, we develop a case study scenario and assess the performance of the MARL technique through simulation in a hypothetical UAM scenario. The solution is evaluated against Q-Mixing (QMIX), Orthogonal Multiple Access and a Heuristic Greedy Algorithm.


  • Joint Velocity and Spectrum Optimization in Urban Air Transportation System via Multi-Agent Deep Reinforcement Learning

    by Ruixuan Han, Hongxiang Li, Eric J. Knoblock, Michael R. Gasper, Rafael D. Apaza

    The emerging concepts of Urban Air Mobility (UAM) and Advanced Air Mobility (AAM) open a new paradigm for urban air transportation. One big challenge is that new aerial vehicles (AV) will quickly saturate the already crowded aviation spectrum, which is an essential resource to ensure reliable communications for safe air operations. In this paper, we consider an air transportation system where multiple AVs are operated to transport passengers or cargo from different sources to destinations along their pre-defined paths. During the flight, the minimum communication Quality of Service (QoS) must be achieved at all times to ensure flight safety. Our objective is to minimize the total mission completion time by jointly optimizing the velocities and spectrum allocation for all AVs. We formulate the optimization problem as a multi-stage Markov game where the optimization variables are coupled together. A multi-agent deep reinforcement learning VD3QN algorithm is proposed to enable cooperative learning among AVs. Additionally, we propose a heuristic greedy algorithm (HGA) and an orthogonal multiple access (OMA) solution as baseline solutions. Extensive simulation results show that our learning-based solution outperforms the baseline solutions under different network configurations.