QGrid: Q-learning based routing protocol for vehicular ad hoc networks
Authors:
- 1 December 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10972641,p. 1-8
Abstract
In Vehicular Ad Hoc Networks (VANETs), moving vehicles are considered as mobile nodes in the network and they are connected to each other via wireless links when they are within the communication radius of each other. Efficient message delivery in VANETs is still a very challenging research issue. In this paper, a Q-learning based routing protocol (i.e., QGrid) is introduced to help to improve the message delivery from mobile vehicles to a specific location. QGrid considers both macroscopic and microscopic aspects when making the routing decision, while the traditional routing methods focus on computing meeting information between different vehicles. QGrid divides the region into different grids. The macroscopic aspect determines the optimal next-hop grid and the microscopic aspect determines the specific vehicle in the optimal next-hop grid to be selected as next-hop vehicle. QGrid computes the Q-values of different movements between neighboring grids for a given destination via Q-learning. Each vehicle stores Q-value table learned offline, then selects optimal next-hop grid by querying Q-value table. Inside the selected next-hop grid, we either greedily select the nearest neighboring vehicle to the destination or select the neighboring vehicle with highest probability of moving to the optimal next-hop grid predicted by the two-order Markov chain. The performance of QGrid is evaluated by using real life trajectory GPS data of Shanghai taxies. Simulation comparison among QGrid and other existing position-based routing protocols confirms the advantages of proposed QGrid routing protocol for VANETs.Keywords
This publication has 15 references indexed in Scilit:
- A novel contact prediction‐based routing scheme for DTNsTransactions on Emerging Telecommunications Technologies, 2014
- GeoMob: A mobility-aware geocast scheme in metropolitans via taxicabs and buses2014
- Multicast capacity analysis for social-proximity urban bus-assisted VANETs2013
- ZOOM: Scaling the mobility for fast opportunistic forwarding in vehicular networks2013
- Routing in VANETs: A fuzzy constraint Q-Learning approach2012
- Adaptive Forwarding Delay Control for VANET Data AggregationIEEE Transactions on Parallel and Distributed Systems, 2011
- Exploiting temporal dependency for opportunistic forwarding in urban vehicular networks2011
- Routing in vehicular ad hoc networks: A surveyIEEE Vehicular Technology Magazine, 2007
- GVGrid: A QoS Routing Protocol for Vehicular Ad Hoc Networks2006
- Q-learningMachine Learning, 1992