Multi-Agent Deep Reinforcement Learning for Interference-Aware Channel Allocation in Non-Terrestrial Networks
- 16 January 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Communications Letters
- Vol. 27 (3) , 936-940
Abstract
Non-terrestrial network (NTN) services using low-Earth-orbit (LEO) satellites are expanding. Interference management of NTN services with other terrestrial wireless services is emerging as a critical issue owing to the inherent international and vast coverage nature of NTN. This study develops a multi-agent deep reinforcement learning (DRL) framework to establish a multi-beam uplink channel allocation strategy that minimizes interference with incumbent stations under the given quality of service (QoS) constraints. We propose a novel framework with the sequential training of agents in a specific order to overcome the inherent non-stationarity of multi-agent DRL. To improve learning efficiency, we design the training sequence in accordance with reward function and initial state. As a result, taking actions in the order of the largest interference to the incumbent station provides superior performance to taking actions in an arbitrary order. Moreover, the proposed channel allocation performs close to the optimal exhaustive search and outperforms conventional greedy graph coloring method.Keywords
Funding Information
- Institute of Information & Communications Technology Planning & Evaluation
- Korea government (2021-0-00719)
This publication has 7 references indexed in Scilit:
- Deep Reinforcement Learning Based Power Allocation for High Throughput Satellites2021
- Machine Learning-Based Resource Allocation in Satellite Networks Supporting Internet of Remote ThingsIEEE Transactions on Wireless Communications, 2021
- Deep Reinforcement Learning for Multiagent Systems: A Review of Challenges, Solutions, and ApplicationsIEEE Transactions on Cybernetics, 2020
- Modeling and Analysis on Radio Interference of OFDM Waveforms for Coexistence StudyIEEE Access, 2019
- Deep Reinforcement Learning Based Dynamic Channel Allocation Algorithm in Multibeam Satellite SystemsIEEE Access, 2018
- Cognitive Radio Techniques Under Practical Imperfections: A SurveyIEEE Communications Surveys & Tutorials, 2015
- List-coloring based channel allocation for open-spectrum wireless networks2006