A Survey on Applications of Model-Free Strategy Learning in Cognitive Wireless Networks
Authors:
- Wenbo WangWWWenbo Wang
- Andres KwasinskiAKAndres Kwasinski
- Dusit NiyatoDNDusit Niyato
- Zhu HanZHZhu Han
Preprint
Abstract
Model-free learning has been considered as an efficient tool for designing control mechanisms when the model of the system environment or the interaction between the decision-making entities is not available as a-priori knowledge. With model-free learning, the decision-making entities adapt their behaviors based on the reinforcement from their interaction with the environment and are able to (implicitly) build the understanding of the system through trial-and-error mechanisms. Such characteristics of model-free learning is highly in accordance with the requirement of cognition-based intelligence for devices in cognitive wireless networks. Recently, model-free learning has been considered as one key implementation approach to adaptive, self-organized network control in cognitive wireless networks. In this paper, we provide a comprehensive survey on the applications of the state-of-the-art model-free learning mechanisms in cognitive wireless networks. According to the system models that those applications are based on, a systematic overview of the learning algorithms in the domains of single-agent system, multi-agent systems and multi-player games is provided. Furthermore, the applications of model-free learning to various problems in cognitive wireless networks are discussed with the focus on how the learning mechanisms help to provide the solutions to these problems and improve the network performance over the existing model-based, non-adaptive methods. Finally, a broadKeywords
All Related Versions
This publication has 115 references indexed in Scilit:
- A stochastic game framework for joint frequency and power allocation in dynamic decentralized cognitive radio networksAEU - International Journal of Electronics and Communications, 2013
- Routing in Distributed Cognitive Radio Networks: A SurveyWireless Personal Communications, 2012
- A constrained MDP-based vertical handoff decision algorithm for 4G heterogeneous wireless networksWireless Networks, 2011
- Routing in cognitive radio networks: Challenges and solutionsAd Hoc Networks, 2010
- A Context Driven Architecture for Cognitive Radio NodesWireless Personal Communications, 2008
- Learning and transfer in signaling gamesEconomic Theory, 2007
- Efficient QoS Provisioning for Adaptive Multimedia in Mobile Communication Networks by Reinforcement LearningMobile Networks and Applications, 2005
- Cooperative Multi-Agent Learning: The State of the ArtAutonomous Agents and Multi-Agent Systems, 2005
- On the geometry of Nash equilibria and correlated equilibriaInternational Journal of Game Theory, 2004
- Sophisticated Experience-Weighted Attraction Learning and Strategic Teaching in Repeated GamesJournal of Economic Theory, 2002