Distributed Q-Learning for Interference Control in OFDMA-Based Femtocell Networks
Authors:
- Ana Galindo-SerranoAGAna Galindo-Serrano
- Lorenza GiupponiLGLorenza Giupponi
- 1 January 2010
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15502252,p. 1-5
Abstract
This paper proposes a self-organized power allocation technique to solve the interference problem caused by a femtocell network operating in the same channel as an orthogonal frequency division multiple access cellular network. We model the femto network as a multi-agent system where the different femto base stations are the agents in charge of managing the radio resources to be allocated to their femtousers. We propose a form of real-time multi-agent reinforcement learning, known as decentralized Q-learning, to manage the interference generated to macro-users. By directly interacting with the surrounding environment in a distributed fashion, the multi-agent system is able to learn an optimal policy to solve the interference problem. Simulation results show that the introduction of the femto network increases the system capacity without decreasing the capacity of the macro network.Keywords
This publication has 6 references indexed in Scilit:
- Femtocells2009
- Distributed Power Control Mechanisms for HSDPA Femtocells2009
- Access methods to WiMAX femtocells: A downlink system-level case study2008
- Femtocell networks: a surveyIEEE Communications Magazine, 2008
- Cooperative Multi-Agent Learning: The State of the ArtAutonomous Agents and Multi-Agent Systems, 2005
- Q-learningMachine Learning, 1992