Reinforcement Learning for Energy-Efficient 5G Massive MIMO: Intelligent Antenna Switching
Open Access
- 16 September 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 9, 130329-130339
Abstract
To provide users with high throughputs, the fifth generation (5G) and beyond networks are expected to utilize the Massive Multiple-Input Multiple-Output technology (MMIMO), i.e., large antenna arrays. However, additional antennas require the installation of dedicated hardware. As a result the power consumption of a 5G MMIMO network grows. This implies, e.g., higher operator costs. From this angle, the improvement of Energy Efficiency (EE) is identified as one of the key challenges for the 5G and beyond networks. EE can be improved through intelligent antenna switching, i.e., disabling some of the antennas installed at a 5G MMIMO Base Station (BS) when there are few User Equipments (UEs) within the cell area. To improve EE in this scenario we propose to utilize a sub-class of Machine Learning techniques named Reinforcement Learning (RL). Because 5G and beyond networks are expected to come with accurate UE localization, the proposed RL algorithm is based on UE location information stored in an intelligent database named a Radio Environment Map (REM). Two approaches are proposed: first EE is maximized independently for every set of UEs’ positions. After that the process of learning is accelerated by exploiting similarities between data in REM, i.e., REM-Empowered Action Selection Algorithm (REASA) is proposed. The proposed RL algorithms are evaluated with the use of a realistic simulator of the 5G MMIMO network utilizing an accurate 3D-Ray-Tracing radio channel model. The utilization of RL provides about 18.5% EE gains over algorithms based on standard optimization methods. Moreover, when REASA is used the process of learning can be accomplished approximately two times faster.Keywords
Funding Information
- Polish Ministry of Science and Higher Education subvention within the task “New methods of increasing energy and spectral efficiency and localization awareness for mobile systems”, in 2020 (0312/SBAD/8158)
This publication has 36 references indexed in Scilit:
- Massive MIMO in Real Propagation Environments: Do All Antennas Contribute Equally?IEEE Transactions on Communications, 2015
- Is green networking beneficial in terms of device lifetime?IEEE Communications Magazine, 2015
- Optimal Design of Energy-Efficient Multi-User MIMO Systems: Is Massive MIMO the Answer?IEEE Transactions on Wireless Communications, 2015
- On Metrics and Models for Energy-Efficient Design of Wireless Access NetworksIEEE Wireless Communications Letters, 2014
- Optimal Multiuser Transmit Beamforming: A Difficult Problem with a Simple Solution Structure [Lecture Notes]IEEE Signal Processing Magazine, 2014
- Channel measurements and analysis for very large array systems at 2.6 GHz2012
- Antenna selection technique for MIMO-OFDM systems over frequency selective Rayleigh fading channelIET Communications, 2007
- Analysis of Transmit Antenna Selection/Maximal-Ratio Combining in Rayleigh Fading ChannelsIEEE Transactions on Vehicular Technology, 2005
- Energy-Efficiency of MIMO and Cooperative MIMO Techniques in Sensor NetworksIEEE Journal on Selected Areas in Communications, 2004
- Comparing images using the Hausdorff distanceIEEE Transactions on Pattern Analysis and Machine Intelligence, 1993