A DDPG-LSTM Framework for Optimizing UAV-Enabled Integrated Sensing and Communication
Open Access
Abstract
This paper proposes a novel dual-functional radar-communication (DFRC) framework that integrates unmanned aerial vehicle (UAV) communications into an integrated sensing and communication (ISAC) system, termed the ISAC-UAV architecture. In this system, the UAV’s mobility is leveraged to simultaneously serve multiple single-antenna uplink users (UEs) and perform radar-based sensing tasks. A key challenge stems from the target position uncertainty due to movement, which impairs matched filtering and beamforming, thereby degrading both uplink reception and sensing performance. Moreover, UAV energy consumption associated with mobility must be considered to ensure energy-efficient operation. We aim to jointly maximize radar sensing accuracy and minimize UAV movement energy over multiple time steps, while maintaining reliable uplink communications. To address this multi-objective optimization, we propose a deep reinforcement learning (DRL) framework based on a long short-term memory (LSTM)-enhanced deep deterministic policy gradient (DDPG) network. By leveraging historical target trajectory data, the model improves prediction of target positions, enhancing sensing accuracy. The proposed DRL-based approach enables joint optimization of UAV trajectory and uplink power control over time. Extensive simulations validate that our method significantly improves communication quality and sensing performance, while ensuring energy-efficient UAV operation. Comparative results further confirm the model’s adaptability and robustness in dynamic environments, outperforming existing UAV trajectory planning and resource allocation benchmarks.Keywords
Funding Information
- National Research Foundation of Korea (NRF) (RS-2023-00208995, RS-2025-02214082)
This publication has 44 references indexed in Scilit:
- Beamforming design and trajectory optimization for integrated sensing and communication supported by multiple UAVs based on DRLVehicular Communications, 2025
- A Survey on Integrated Sensing, Communication, and ComputationIEEE Communications Surveys & Tutorials, 2024
- Distributed DRL-Based Integrated Sensing, Communication, and Computation in Cooperative UAV-Enabled Intelligent Transportation SystemsIEEE Internet of Things Journal, 2024
- Physical Layer Security for IRS-UAV-Assisted Cell-Free Massive MIMO SystemsIEEE Access, 2024
- Joint Resource Allocation and Trajectory Design for Energy-Efficient UAV Assisted Networks With User Fairness GuaranteeIEEE Internet of Things Journal, 2024
- In-Band Full-Duplex: The Physical LayerProceedings of the IEEE, 2024
- UAV-Enabled Integrated Sensing, Computing, and Communication for Internet of Things: Joint Resource Allocation and Trajectory DesignIEEE Internet of Things Journal, 2023
- Full-Duplex Communication for ISAC: Joint Beamforming and Power OptimizationIEEE Journal on Selected Areas in Communications, 2023
- Enabling Joint Communication and Radar Sensing in Mobile Networks—A SurveyIEEE Communications Surveys & Tutorials, 2021
- UAV Swarm Intelligence: Recent Advances and Future TrendsIEEE Access, 2020