cGAIL: Conditional Generative Adversarial Imitation Learning—An Application in Taxi Drivers’ Strategy Learning
- 23 November 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Big Data
- Vol. 8 (5) , 1288-1300
Abstract
Smart passenger-seeking strategies employed by taxi drivers contribute not only to drivers’ incomes, but also higher quality of service passengers received. Therefore, understanding taxi drivers’ behaviors and learning the good passenger-seeking strategies are crucial to boost taxi drivers’ well-being and public transportation quality of service. However, we observe that drivers’ preferences of choosing which area to find the next passenger are diverse and dynamic across locations and drivers. It is hard to learn the location-dependent preferences given the partial data (i.e., an individual driver's trajectory may not cover all locations). In this paper, we make the first attempt to develop conditional generative adversarial imitation learning (cGAIL) model, as a unifying collective inverse reinforcement learning framework that learns the driver's decision-making preferences and policies by transferring knowledge across taxi driver agents and across locations. Our evaluation results on three months of taxi GPS trajectory data in Shenzhen, China, demonstrate that the driver's preferences and policies learned from cGAIL are on average 34.7% more accurate than those learned from other state-of-the-art baseline approaches.Keywords
Funding Information
- National Science Foundation (IIS-1942680 (CAREER), CNS-1952085, CMMI-1831140, DGE-2021871)
- Safety Research Using Simulation University Transportation Center
- U.S. Department of Transportation (69A3551747131)
This publication has 26 references indexed in Scilit:
- Growing the charging station network for electric vehicles with trajectory data analytics2015
- Urban ComputingACM Transactions on Intelligent Systems and Technology, 2014
- Partially Observable Markov Decision Processes2012
- A taxi business intelligence system2011
- An energy-efficient mobile recommender system2010
- A survey of robot learning from demonstrationRobotics and Autonomous Systems, 2009
- Reinforcement Learning: An IntroductionIEEE Transactions on Neural Networks, 1998
- Efficient Training of Artificial Neural Networks for Autonomous NavigationNeural Computation, 1991
- A Generalized Wilcoxon Test for Comparing Arbitrarily Singly-Censored SamplesBiometrika, 1965
- On Information and SufficiencyThe Annals of Mathematical Statistics, 1951