Echo State Networks for Self-Organizing Resource Allocation in LTE-U With Uplink–Downlink Decoupling
Authors:
Open Access
- 11 October 2016
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Wireless Communications
- Vol. 16 (1) , 3-16
Abstract
Uplink-downlink decoupling in which users can be associated to different base stations in the uplink and downlink of heterogeneous small cell networks (SCNs) has attracted significant attention recently. However, most existing works focus on simple association mechanisms in LTE SCNs that operate only in the licensed band. In contrast, in this paper, the problem of resource allocation with uplink-downlink decoupling is studied for an SCN that incorporates LTE in the unlicensed band. Here, the users can access both licensed and unlicensed bands while being associated to different base stations. This problem is formulated as a noncooperative game that incorporates user association, spectrum allocation, and load balancing. To solve this problem, a distributed algorithm based on the machine learning framework of echo state networks (ESNs) is proposed. This proposed algorithm allows the small base stations to autonomously choose their optimal resource allocation strategies given only limited information on the network's and users' states. It is shown that the proposed algorithm converges to a stationary mixed-strategy distribution, which constitutes a mixed strategy Nash equilibrium for their studied game. Simulation results show that the proposed approach yields significant gain, in terms of the sum-rate of the 50th percentile of users, that reaches up to 167% compared with a Q-learning algorithm. The results also show that the ESN significantly provides a considerable reduction of information exchange for the wireless network.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (61671086, 61629101, 61271257)
- U.S. National Science Foundation (CNS-1460316, CNS-1513697, ACI-1541105)
This publication has 31 references indexed in Scilit:
- LTE-unlicensed: the future of spectrum aggregation for cellular networksIEEE Wireless Communications, 2015
- Joint Rate and SINR Coverage Analysis for Decoupled Uplink-Downlink Biased Cell Associations in HetNetsIEEE Transactions on Wireless Communications, 2015
- Equalization of the Non-Linear Satellite Communication Channel with an Echo State Network2015
- Resource Allocation and Inter-Cell Interference Management for Dual-Access Small CellsIEEE Journal on Selected Areas in Communications, 2015
- Small-Cell Traffic Balancing Over Licensed and Unlicensed BandsIEEE Transactions on Vehicular Technology, 2015
- Dynamic Resource Allocation for Cooperative Spectrum Sharing in LTE NetworksIEEE Transactions on Vehicular Technology, 2014
- Multiagent Reinforcement Learning With Unshared Value FunctionsIEEE Transactions on Cybernetics, 2014
- Using Echo State Networks to Characterise Wireless Channels2013
- Reinforcement Learning with Echo State Networks2006
- Admission control in IEEE 802.11e wireless LANsIEEE Network, 2005