Autonomic Joint Session Scheduling Strategies for Heterogeneous Wireless Networks
Authors:
- Zhiyong FengZFZhiyong Feng
- Huying CaiHCHuying Cai
- Cheng ChiCCCheng Chi
- 1 March 2008
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15253511,p. 2045-2050
Abstract
In order to optimize usage of radio resource for heterogeneous radio access technologies (RATs) and jointly designed from the user perspective, the joint session scheduling (JOSCH) mechanism has been introduced to split traffic over tightly coupled radio network. This paper presents distributed reinforcement learning (RL) as an autonomic approach for the JOSCH. Through the "trial-and-error" interaction with its radio environment, the JOSCH agent learns to split the traffic in a best way and allocate sub-streams in the proper RATs. A backpropagation neural network is adopted to generalize the large input state space of the RL algorithm to reduce memory requirement. Extensive simulations show that the proposed algorithm not only realizes the autonomy of JOSCH through the online learning process, but also improves the service quality at user side and the spectrum utility at operator side base on the suitable strategies.Keywords
This publication has 11 references indexed in Scilit:
- Joint Radio Resource Scheduling based on Generic Link Layer2006
- Network selection in an integrated wireless LAN and UMTS environment using mathematical modeling and computing techniquesIEEE Wireless Communications, 2005
- Rate performance objectives of multihop wireless networksIEEE Transactions on Mobile Computing, 2004
- Dynamic channel allocation for mobile cellular traffic using reduced-state reinforcement learning2004
- Investigation of radio resource scheduling in WLANs coupled with 3G cellular networkIEEE Communications Magazine, 2003
- Dynamic channel assignment in cellular networks: a reinforcement learning solution2003
- Overview of fine granularity scalability in MPEG-4 video standardIEEE Transactions on Circuits and Systems for Video Technology, 2001
- Handoff in hybrid mobile data networksIEEE Wireless Communications, 2000
- A Q-learning-based dynamic channel assignment technique for mobile communication systemsIEEE Transactions on Vehicular Technology, 1999
- Q-learningMachine Learning, 1992