LORM: Learning to Optimize for Resource Management in Wireless Networks With Few Training Samples
- 22 October 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Wireless Communications
- Vol. 19 (1) , 665-679
Abstract
Effective resource management plays a pivotal role in wireless networks, which, unfortunately, typically results in challenging mixed-integer nonlinear programming (MINLP) problems. Machine learning-based methods have recently emerged as a disruptive way to obtain near-optimal performance for MINLPs with affordable computational complexity. There have been some attempts in applying such methods to resource management in wireless networks, but these attempts require huge amounts of training samples and lack the capability to handle constrained problems. Furthermore, they suffer from severe performance deterioration when the network parameters change, which commonly happens and is referred to as the task mismatch problem. In this paper, to reduce the sample complexity and address the feasibility issue, we propose a framework of Learning to Optimize for Resource Management (LORM). In contrast to the end-to-end learning approach adopted in previous studies, LORM learns the optimal pruning policy in the branch-and-bound algorithm for MINLPs via a sample-efficient method, namely, imitation learning. To further address the task mismatch problem, we develop a transfer learning method via self-imitation in LORM, named LORM-TL, which can quickly adapt a pre-trained machine learning model to the new task with only a few additional unlabeled training samples. Numerical simulations demonstrate that LORM outperforms specialized state-of-the-art algorithms and achieves near-optimal performance, while providing significant speedup compared with the branch-and-bound algorithm. Moreover, LORM-TL, by relying on a few unlabeled samples, achieves comparable performance with the model trained from scratch with sufficient labeled samples.Keywords
All Related Versions
Funding Information
- General Research Funding from the Research Grants Council of Hong Kong (16210719)
- National Natural Science Foundation of China (61601290)
This publication has 19 references indexed in Scilit:
- Dynamic Computation Offloading for Mobile-Edge Computing With Energy Harvesting DevicesIEEE Journal on Selected Areas in Communications, 2016
- Conic Optimization via Operator Splitting and Homogeneous Self-Dual EmbeddingJournal of Optimization Theory and Applications, 2016
- Mastering the game of Go with deep neural networks and tree searchNature, 2016
- Large-Scale Convex Optimization for Dense Wireless Cooperative NetworksIEEE Transactions on Signal Processing, 2015
- Group Sparse Beamforming for Green Cloud-RANIEEE Transactions on Wireless Communications, 2014
- Integer Programming2014
- Signal Processing and Optimal Resource Allocation for the Interference Channel2014
- User Association for Load Balancing in Heterogeneous Cellular NetworksIEEE Transactions on Wireless Communications, 2013
- A Survey on Transfer LearningIEEE Transactions on Knowledge and Data Engineering, 2009
- Multiuser OFDM with adaptive subcarrier, bit, and power allocationIEEE Journal on Selected Areas in Communications, 1999