Qian Gao
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Qian Gao has a total of 9 co-authors. Here are the top co-authors by number of shared publications:
- Hyundong Shin
Kyung Hee University
6 shared publications - Ruikang Zhong
School of Information and Communication Engineering, Xian Jiaotong University, Xian, China
6 shared publications - Yuanwei Liu
University of Hong Kong
6 shared publications - Changsheng Jiang
Institute of Geophysics, China Earthquake Administration, Beijing 100081, China
1 shared publication - Mugen Peng
Beijing University of Posts and Telecommunications
1 shared publication - Naibao He
Huaihai Institute of Techology, Lianyungang 222005, China
1 shared publication
Latest Publications
- 18 March 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. PP (00189545) , 1-6
RL Based Beamforming Optimization for 3D Pinching Antenna Assisted ISAC Systems
In this paper, a three-dimensional (3D) deployment scheme of pinching antenna array is proposed, aiming to enhances the performance of integrated sensing and communication (ISAC) systems. To fully realize the potential of 3D deployment, a joint antenna positioning, time allocation and transmit power optimization problem is formulated to maximize the sum communication rate with the constraints of target sensing rates and system energy. To solve the sum rate maximization problem, we propose a heterogeneous graph neural network based reinforcement learning (HGRL) algorithm. Simulation results show that the proposed 3D pinching antenna deployment improves the ISAC performance significantly, achieving around 10–20% higher communication rate compared with conventional 1D/2D layouts, while maintaining the sensing SNR near the required threshold with substantially lower power consumption. Moreover, the proposed HGRL algorithm surpasses other baselines in both performance and convergence speed due to the advanced observation construction of the environment.
- 18 March 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. PP (00189545) , 1-6
RL Based Beamforming Optimization for 3D Pinching Antenna Assisted ISAC Systems
In this paper, a three-dimensional (3D) deployment scheme of pinching antenna array is proposed, aiming to enhances the performance of integrated sensing and communication (ISAC) systems. To fully realize the potential of 3D deployment, a joint antenna positioning, time allocation and transmit power optimization problem is formulated to maximize the sum communication rate with the constraints of target sensing rates and system energy. To solve the sum rate maximization problem, we propose a heterogeneous graph neural network based reinforcement learning (HGRL) algorithm. Simulation results show that the proposed 3D pinching antenna deployment improves the ISAC performance significantly, achieving around 10–20% higher communication rate compared with conventional 1D/2D layouts, while maintaining the sensing SNR near the required threshold with substantially lower power consumption. Moreover, the proposed HGRL algorithm surpasses other baselines in both performance and convergence speed due to the advanced observation construction of the environment.
- 12 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Wireless Communications
- Vol. 25 (15361276) , 8754-8768
Deep Learning-Based Beamforming Optimization for ISAC Systems: A Low-Complexity and Transferable Framework
Due to the increasing number of users and antennas in extremely large antenna arrays (ELAA) based integrated sensing and communication (ISAC) systems, the complexity of beamforming optimization becomes overwhelming, which impedes real-time and cost-efficient ISAC deployment in practice. Specifically, a general ISAC system where the base station (BS) communicates with multiple users and performs target detection is considered. Then, a sum communication rate maximization problem is formulated, subjected to the constraints of transmit power and the minimum sensing rates of users. To solve this problem, we develop a framework that leverages deep learning algorithms to provide a low complexity and transferable (LCT) solution for ISAC beamforming. The proposed LCT beamforming optimization framework includes three modules: 1) an unsupervised learning based feature extraction algorithm is proposed to extract fixed-size latent features while keeping its essential information from the variable channel state information (CSI); 2) a reinforcement learning (RL) based beampattern optimization algorithm is proposed to search the desired beampattern according to the extracted features; 3) a supervised learning based beamforming reconstruction algorithm is proposed to reconstruct the beamforming vector from beampattern given by the RL agent. Simulation results demonstrate that the proposed LCT framework outperforms the baseline RL algorithm by optimizing the intuitional beampattern rather than beamforming. Moreover, the LCT framework provides a solution for low-cost beamforming optimization in ISAC systems. The trained RL module can be transferred without retraining when the antenna or user number changes.
- 12 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Wireless Communications
- Vol. 25 (15361276) , 8754-8768
Deep Learning-Based Beamforming Optimization for ISAC Systems: A Low-Complexity and Transferable Framework
Due to the increasing number of users and antennas in extremely large antenna arrays (ELAA) based integrated sensing and communication (ISAC) systems, the complexity of beamforming optimization becomes overwhelming, which impedes real-time and cost-efficient ISAC deployment in practice. Specifically, a general ISAC system where the base station (BS) communicates with multiple users and performs target detection is considered. Then, a sum communication rate maximization problem is formulated, subjected to the constraints of transmit power and the minimum sensing rates of users. To solve this problem, we develop a framework that leverages deep learning algorithms to provide a low complexity and transferable (LCT) solution for ISAC beamforming. The proposed LCT beamforming optimization framework includes three modules: 1) an unsupervised learning based feature extraction algorithm is proposed to extract fixed-size latent features while keeping its essential information from the variable channel state information (CSI); 2) a reinforcement learning (RL) based beampattern optimization algorithm is proposed to search the desired beampattern according to the extracted features; 3) a supervised learning based beamforming reconstruction algorithm is proposed to reconstruct the beamforming vector from beampattern given by the RL agent. Simulation results demonstrate that the proposed LCT framework outperforms the baseline RL algorithm by optimizing the intuitional beampattern rather than beamforming. Moreover, the LCT framework provides a solution for low-cost beamforming optimization in ISAC systems. The trained RL module can be transferred without retraining when the antenna or user number changes.
- 28 May 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 74 (11) , 17865-17878
Distributed Antenna Selection and Beamforming for ELAA Based Downlink ISAC Systems
An extremely large-scale antenna array (ELAA) based integrated sensing and communication (ISAC) system is investigated. Focusing on a practical user-roaming environment, the ISAC beamforming design and antenna selection for ELAA are studied. In particular, two antenna selection schemes, namely, movable subarray selection (MSS) and adjustable antenna selection (ASS), are proposed to provide low complexity and flexible beamforming design. For each proposed scheme, a long-term sum rate maximization problem is formulated via jointly optimizing the antenna selection and beamforming, subject to the constraints of transmitting power and beampattern gain for target sensing. To address this problem, a dimension reduction assisted multi-agent proximal policy optimization (DR-MAPPO) algorithm, which can be used for different antenna selection schemes, is developed. An OrderConv layer is designed, which reduces the input dimension by removing the channel state information (CSI) of unselected antennas while keeping the order information of selected ones. Moreover, multiple agents are employed to execute antenna selection and beamforming in a distributed manner according to current channel state information and previous antenna selection, which can reduce the complexity by decomposing the problem. Numerical results demonstrate that MSS outperforms the fixed subarray selection by providing more degrees of freedom and ASS further surpasses MSS through adopting changeable subarray shape. Moreover, the proposed DR-MAPPO algorithm improves the computational efficiency and achieves preferable data rates compared to original MAPPO algorithm.
- 28 May 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 74 (11) , 17865-17878
Distributed Antenna Selection and Beamforming for ELAA Based Downlink ISAC Systems
An extremely large-scale antenna array (ELAA) based integrated sensing and communication (ISAC) system is investigated. Focusing on a practical user-roaming environment, the ISAC beamforming design and antenna selection for ELAA are studied. In particular, two antenna selection schemes, namely, movable subarray selection (MSS) and adjustable antenna selection (ASS), are proposed to provide low complexity and flexible beamforming design. For each proposed scheme, a long-term sum rate maximization problem is formulated via jointly optimizing the antenna selection and beamforming, subject to the constraints of transmitting power and beampattern gain for target sensing. To address this problem, a dimension reduction assisted multi-agent proximal policy optimization (DR-MAPPO) algorithm, which can be used for different antenna selection schemes, is developed. An OrderConv layer is designed, which reduces the input dimension by removing the channel state information (CSI) of unselected antennas while keeping the order information of selected ones. Moreover, multiple agents are employed to execute antenna selection and beamforming in a distributed manner according to current channel state information and previous antenna selection, which can reduce the complexity by decomposing the problem. Numerical results demonstrate that MSS outperforms the fixed subarray selection by providing more degrees of freedom and ASS further surpasses MSS through adopting changeable subarray shape. Moreover, the proposed DR-MAPPO algorithm improves the computational efficiency and achieves preferable data rates compared to original MAPPO algorithm.
- 3 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 11 (24) , 40492-40505
MARL-Based UAV Trajectory and Beamforming Optimization for ISAC System
A multiple unmanned aerial vehicle (UAV) enabled integrated sensing and communication (ISAC) system is investigated. In contrast to existing UAV-enabled ISAC systems assuming static users or 2-D UAV trajectory, we consider a practical roaming user scenario and a 3-D deployment for UAVs. Then, a joint trajectory and beamforming optimization problem is formulated for maximizing the long-term sum data rate, subject to the transmitting power constraint and ensuring beam pattern gain constraint for sensing target. To address the challenge caused by the dynamic and high dimensionality features, multiagent reinforcement learning (MARL) is employed for this partial observation Markov decision process (POMDP) problem. We proposed a two-step approach for against the dynamic scenario: 1) a K-means-based hierarchical user association algorithm is proposed to renew the user association periodically and 2) a hybrid reward multiagent proximal policy optimization (HR-MAPPO) algorithm is proposed, which decomposes the complex combined reward into a team reward and an individual reward. HR-MAPPO introduces a hyperparameter to control the proportion of team/individual action. Numerical results demonstrate that the proposed HR-MAPPO algorithm can outperform the conventional single-agent and multiagent RL algorithms by maintaining high scores on both the sum data rate and beam pattern gain.
- 3 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 11 (24) , 40492-40505
MARL-Based UAV Trajectory and Beamforming Optimization for ISAC System
A multiple unmanned aerial vehicle (UAV) enabled integrated sensing and communication (ISAC) system is investigated. In contrast to existing UAV-enabled ISAC systems assuming static users or 2-D UAV trajectory, we consider a practical roaming user scenario and a 3-D deployment for UAVs. Then, a joint trajectory and beamforming optimization problem is formulated for maximizing the long-term sum data rate, subject to the transmitting power constraint and ensuring beam pattern gain constraint for sensing target. To address the challenge caused by the dynamic and high dimensionality features, multiagent reinforcement learning (MARL) is employed for this partial observation Markov decision process (POMDP) problem. We proposed a two-step approach for against the dynamic scenario: 1) a K-means-based hierarchical user association algorithm is proposed to renew the user association periodically and 2) a hybrid reward multiagent proximal policy optimization (HR-MAPPO) algorithm is proposed, which decomposes the complex combined reward into a team reward and an individual reward. HR-MAPPO introduces a hyperparameter to control the proportion of team/individual action. Numerical results demonstrate that the proposed HR-MAPPO algorithm can outperform the conventional single-agent and multiagent RL algorithms by maintaining high scores on both the sum data rate and beam pattern gain.
- Open Access
- 1 January 2011
- Published by Elsevier in Procedia Engineering
- Vol. 15, 1229-1233
Robust adaptive control for a class of chaotic system using backstepping
- 1 January 2011
- Published by Elsevier in Procedia Engineering
- Vol. 15, 1229-1233
Open AccessRobust adaptive control for a class of chaotic system using backstepping