A Reinforcement Learning Approach to Call Admission and Call Dropping Control in Links with Variable Capacity
- 1 January 2011
- journal article
- Published by Elsevier in European Journal of Control
- Vol. 17 (1)
Abstract
This paper defines a reinforcement learning (RL) approach to call control algorithms in links with variable capacity supporting multiple classes of service. The novelties of the document are the following: i) the problem is modeled as a constrained Markov decision process (MDP); ii) the constrained MDP is solved via a RL algorithm by using the Lagrangian approach and state aggregation. The proposed approach is capable of controlling classlevel quality of service in terms of both blocking and dropping probabilities. Numerical simulations show the effectiveness of the approach.Keywords
This publication has 18 references indexed in Scilit:
- Optimal Call Admission and Call Dropping Control in Links with Variable CapacityEuropean Journal of Control, 2009
- Admission Control in UMTS Networks based on Approximate Dynamic ProgrammingEuropean Journal of Control, 2008
- ${Q}$-Learning Algorithms for Constrained Markov Decision Processes With Randomized Monotone Policies: Application to MIMO Transmission ControlIEEE Transactions on Signal Processing, 2007
- Optimal and Structured Call Admission Control Policies for Resource-Sharing SystemsIEEE Transactions on Communications, 2007
- A new reward model for MDP state aggregation with application to CAC and RoutingEuropean Transactions on Telecommunications, 2004
- Finite-State Markov Modeling of Correlated Rician-Fading ChannelsIEEE Transactions on Vehicular Technology, 2004
- Optimal resource allocation in multi-class networks with user-specified utility functionsComputer Networks, 2002
- Admission control schemes to provide class-level QoS in multiservice networksComputer Networks, 2001
- Time-average optimal constrained semi-Markov decision processesAdvances in Applied Probability, 1986
- Optimal policies for controlled Markov chains with a constraintJournal of Mathematical Analysis and Applications, 1985