Beamforming for STAR-RIS-Aided Integrated Sensing and Communication Using Meta DRL
- 10 January 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Wireless Communications Letters
- Vol. 13 (4) , 919-923
Abstract
We consider an integrated sensing and communication (ISAC) system, in which a simultaneously transmitting and reflecting reconfigurable intelligent surface (STAR-RIS) assists a base station in transmitting communication signals to mobile users and conducting sensing tasks toward specific targets. We formulate a transmit beamforming and phase shift optimization problem to jointly maximize the total communication data rate and total effective sensing power. The optimization problem is inherently non-convex, making it challenging to find an optimal solution. To tackle this difficulty, we propose a meta soft actorcritic (meta-SAC) algorithm, which is a fusion of the SAC algorithm and meta-learning techniques. Through extensive simulations, we demonstrate that the proposed meta-SAC algorithm outperforms traditional deep reinforcement learning methods, thus showing its potential to enhance the performance of ISAC systems significantly.Keywords
Funding Information
- University of Oulu and the Research Council of Finland (Profi6 336449)
This publication has 15 references indexed in Scilit:
- A Survey on STAR-RIS: Use Cases, Recent Advances, and Future Research ChallengesIEEE Internet of Things Journal, 2023
- Sum-Rate Maximization for RIS-Assisted Integrated Sensing and Communication Systems With Manifold OptimizationIEEE Transactions on Communications, 2023
- STAR-RIS Assisted Full-Duplex Systems: Impact of Correlation and MaximizationIEEE Communications Letters, 2022
- Joint Beamforming Design for RIS-Assisted Integrated Sensing and Communication SystemsIEEE Transactions on Vehicular Technology, 2022
- Uplink Cascaded Channel Estimation for Intelligent Reflecting Surface Assisted Multiuser MISO SystemsIEEE Transactions on Signal Processing, 2022
- Learning-Based Predictive Beamforming for Integrated Sensing and Communication in Vehicular NetworksIEEE Journal on Selected Areas in Communications, 2022
- Intelligent Reflection Enabling Technologies for Integrated and Green Internet-of-Everything Beyond 5G: Communication, Sensing, and SecurityIEEE Wireless Communications, 2022
- Proximal Policy Optimization-Based Transmit Beamforming and Phase-Shift Design in an IRS-Aided ISAC System for the THz BandIEEE Journal on Selected Areas in Communications, 2022
- Meta-Reinforcement Learning Based Resource Allocation for Dynamic V2X CommunicationsIEEE Transactions on Vehicular Technology, 2021
- Meta-Learning in Neural Networks: A SurveyIEEE Transactions on Pattern Analysis and Machine Intelligence, 2021