When Do Drivers Concentrate? Attention-based Driver Behavior Modeling With Deep Reinforcement Learning
Preprint
Abstract
Driver distraction a significant risk to driving safety. Apart from spatial domain, research on temporal inattention is also necessary. This paper aims to figure out the pattern of drivers' temporal attention allocation. In this paper, we propose an actor-critic method - Attention-based Twin Delayed Deep Deterministic policy gradient (ATD3) algorithm to approximate a driver' s action according to observations and measure the driver' s attention allocation for consecutive time steps in car-following model. Considering reaction time, we construct the attention mechanism in the actor network to capture temporal dependencies of consecutive observations. In the critic network, we employ Twin Delayed Deep Deterministic policy gradient algorithm (TD3) to address overestimated value estimates persisting in the actor-critic algorithm. We conduct experiments on real-world vehicle trajectory datasets and show that the accuracy of our proposed approach outperforms seven baseline algorithms. Moreover, the results reveal that the attention of the drivers in smooth vehicles is uniformly distributed in previous observations while they keep their attention to recent observations when sudden decreases of relative speeds occur. This study is the first contribution to drivers' temporal attention and provides scientific support for safety measures in transportation systems from the perspective of data mining.Keywords
All Related Versions
This publication has 9 references indexed in Scilit:
- Human-like autonomous car-following model with deep reinforcement learningTransportation Research Part C: Emerging Technologies, 2018
- Modeling car-following behavior on urban expressways in Shanghai: A naturalistic driving studyTransportation Research Part C: Emerging Technologies, 2018
- Capturing Car-Following Behaviors by Deep LearningIEEE Transactions on Intelligent Transportation Systems, 2017
- Distinguishing patterns in drivers’ visual attention allocation using Hidden Markov ModelsTransportation Research Part F: Traffic Psychology and Behaviour, 2016
- Real time detection of driver attention: Emerging solutions based on robust iconic classifiers and dictionary of posesTransportation Research Part C: Emerging Technologies, 2014
- Driver distraction and driver inattention: Definition, relationship and taxonomyAccident Analysis & Prevention, 2011
- Conflicts of interest: The implications of roadside advertising for driver attentionTransportation Research Part F: Traffic Psychology and Behaviour, 2009
- Observed Driver Glance Behavior at Roadside Advertising SignsTransportation Research Record: Journal of the Transportation Research Board, 2004
- Congested traffic states in empirical observations and microscopic simulationsPhysical Review E, 2000