Single‐state Q‐learning for self‐organised radio resource management in dual‐hop 5G high capacity density networks
Authors:
- 4 February 2016
- journal article
- research article
- Published by Wiley in Transactions on Emerging Telecommunications Technologies
- Vol. 27 (12) , 1628-1640
Abstract
In this paper, a dual‐hop wireless backhaul and small cell access network has been exploited with effective spectrum sharing to provide 1 Gb/s/km2 ultra‐high capacity density for 5G ultra‐dense network deployments. We develop a single‐state Q‐learning‐based radio resource management algorithm for dynamic spectrum access creating a self‐organised network. It intelligently utilises the instantaneous spectrum observation information from spectrum sensing or a database to learn long‐term optimised decisions based on historical information of the system. The conventional Q‐learning algorithm with state‐action pairs has been simplified to a stateless format and applied in a fully distributed manner on individual data file transmissions, which reduces the complexity of the learning model and improves the applicability of Q‐learning algorithms to self‐organised wireless networks. The results show that not only does the proposed algorithm completely remove the requirement for frequency planning but it also improves the convergence, Quality of Service and system capacity substantially by achieving higher link capacity on both access and backhaul networks. Copyright © 2016 John Wiley & Sons, Ltd.Keywords
Funding Information
- Seventh Framework Programme (248267)
This publication has 20 references indexed in Scilit:
- Overlapping coalitions for D2D-supported data uploading in LTE-A systems2015
- On the limits of predictability in real-world radio spectrum state dynamics: from entropy theory to 5G spectrum sharingIEEE Communications Magazine, 2015
- The METIS 5G Architecture: A Summary of METIS Work on 5G Architectures2015
- Effective RAT Selection Approach for 5G Dense Wireless Networks2015
- Transfer learning and cooperation management: balancing the quality of service and information exchange overhead in cognitive radio networksTransactions on Emerging Telecommunications Technologies, 2014
- Challenges in 5G: how to empower SON with big data for enabling 5GIEEE Network, 2014
- Tradeoff between spectrum cost and quality of service in a cognitive radio network2013
- Statistical analysis of non orthogonal spectrum sharing and scheduling strategies in next generation mobile networks2013
- Two-stage reinforcement-learning-based cognitive radio with exploration controlIET Communications, 2011
- A Q-learning-based dynamic channel assignment technique for mobile communication systemsIEEE Transactions on Vehicular Technology, 1999