Spectrum Efficient Mode Selection and Resource Allocation Optimization for D2D Communication in HetNet: A Multi-Agent Q-Learning Approach
Open Access
- 21 August 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 131217-131229
Abstract
Device-to-device (D2D) communication has shown great potential as a technology for beyond-fifth-generation (B5G) heterogeneous networks (HetNets) to meet the increasing needs of smart mobile devices. However, the implementation of D2D communications is accompanied by various technical challenges and obstacles related to channel and power allocation. In this paper, a joint mode selection and resource allocation scheme is proposed to improve Spectrum Efficiency (SE) in relay-aided D2D communications underlaying HetNets while guaranteeing the quality of service (QoS) for D2D pairs and Cellular Users (CUs). The joint mode selection and resource allocation problem is formulated as a mixed-integer nonlinear programming (MINLP) problem, which is notably difficult to solve. Therefore, the optimization problem is decomposed into three subproblems: mode selection, channel allocation, and power allocation to tackle the optimization problem. First, a greedy-based mode selection algorithm is proposed to select the best mode (direct mode, relay-aided mode) for D2D pairs. Second, a Multi-Agent Q-Learning (MAQL) algorithm is presented to assign the optimal channel for D2D pairs. Then, based on the allocated optimal channel, a modified MAQL algorithm is introduced to allocate the optimal power for each D2D transmitter. The simulation results show the effectiveness of the proposed approach compared to other schemes and validate the significant increase in system sum data rate and SE achieved by spectrum sharing with cellular communication.Keywords
Funding Information
- Ministry of Higher Education Malaysia via the Fundamental Research Grant Scheme (FRGS/1/2020/TK0/UM/02/39)
This publication has 34 references indexed in Scilit:
- A survey on essential challenges in relay-aided D2D communication for next-generation cellular networksJournal of Network and Computer Applications, 2023
- Joint uplink–downlink resource allocation for energy efficient D2D underlaying cellular networks with many-to-one matchingPhysical Communication, 2023
- Performance of Q-learning based resource allocation for D2D communications in heterogeneous networksICT Express, 2023
- A Survey of Resource Management in D2D Communication for B5G NetworksIEEE Access, 2023
- 6G Mobile Communication Technology: Requirements, Targets, Applications, Challenges, Advantages, and OpportunitiesAlexandria Engineering Journal, 2022
- RETRACTED ARTICLE: Energy efficient congestion free and adaptive mechanism for data delivery in underwater wireless sensor networks using 2H-ACKOptical and Quantum Electronics, 2022
- A matching-theoretic approach to resource allocation in D2D-enabled downlink NOMA cellular networksPhysical Communication, 2022
- Survey on Device to Device (D2D) Communication for 5GB/6G Networks: Concept, Applications, Challenges, and Future DirectionsIEEE Access, 2022
- Distributed pricing‐based resource allocation for dense device‐to‐device communications in beyond 5G networksTransactions on Emerging Telecommunications Technologies, 2021
- Intensive Benchmarking of D2D communication over 5G cellular networks: prototype, integrated features, challenges, and main applicationsWireless Networks, 2019