Detecting Drivers' Mirror-Checking Actions and Its Application to Maneuver and Secondary Task Recognition
Authors:
- Nanxiang LiNLNanxiang Li
- Carlos BussoCBCarlos Busso
- 11 November 2015
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 17 (4) , 980-992
Abstract
This study explores the feasibility of detecting drivers' mirror-checking actions using noninvasive sensors. Checking the mirrors is an important primary driving action that allows drivers to maintain their situational awareness, particularly when they are planning to turn or change lanes. Recognizing when drivers are checking the mirrors can facilitate the detection of hazard scenarios by considering contextual information (e.g., turning without checking mirrors, lack of mirror-checking actions signaling cognitive distractions, or distinction between gazes due to primary or secondary tasks). This study analyzes drivers' mirror-checking actions under various real driving conditions. We analyze the drivers' mirror-checking actions under normal conditions, as well as when the drivers are engaged in secondary tasks such as tuning the radio or operating a cell phone. We also compare mirror-checking behaviors observed during different maneuver actions: driving straight, turning, and switching lanes. This study reveals statistically significant differences in mirror-checking actions among most of the comparisons. The results suggest that mirror-checking actions can be useful indicators in recognizing drivers engaged in secondary tasks, as well as in detecting driving maneuvers. We propose to detect mirror-checking actions using features extracted from multiple noninvasive sensors (CAN-Bus and cameras facing the driver and the road). We consider three machine learning algorithms for unbalanced data sets, achieving an F-score of 91%. The recognized mirror-checking actions are used as additional features to improve the performance of secondary task detection and maneuver recognition. These promising results suggest that it is possible to detect mirror-checking actions, providing contextual information to improve new driver monitoring systems.Keywords
This publication has 34 references indexed in Scilit:
- Using Perceptual Evaluation to Quantify Cognitive and Visual Driver Distractions2013
- Adaptive Ensemble Models of Extreme Learning Machines for Time Series Prediction2009
- Drowsy Driver Detection Through Facial Movement Analysis2007
- An on-road assessment of cognitive distraction: Impacts on drivers’ visual behavior and braking performanceAccident Analysis & Prevention, 2007
- Neighbor-weighted K-nearest neighbor for unbalanced text corpusExpert Systems with Applications, 2005
- Effects of visual and cognitive load in real and simulated motorway drivingTransportation Research Part F: Traffic Psychology and Behaviour, 2005
- Visual attention while driving: sequences of eye fixations made by experienced and novice driversErgonomics, 2003
- Mental workload while driving: Effects on visual search, discrimination, and decision making.Journal of Experimental Psychology: Applied, 2003
- Simultaneous training of negatively correlated neural networks in an ensembleIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 1999
- Components of driving skill: experience does not mean expertiseErgonomics, 1991