Distracted Driving Detection by Combining ViT and CNN
Authors:
- 4 May 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 908-913
Abstract
The risk of road accidents is rising rapidly. Distracted driving remains one of the leading causes of traffic accidents. Therefore, the identifying of the distracted driving become significant. Extensive methods based on the convolutional neural network (CNN) have been applied to the detection of the distracted driving. Within Convolutional Neural Network (CNN), the convolution operations are good at extracting local features but experience difficulty to capture global representations. Within visual transformer (ViT), the cascaded self-attention modules perform surpassingly in capturing content-based global interactions but unfortunately deteriorate local feature details. In order to address those challenges mentioned before, we propose a new distracted driving detection method that utilizes the driver and related object cues as guidance and combines CNN with ViT as a backbone to capture the local and global features. Besides, the simulation module is introduced to obtain the result of classification during a certain time period in the stage of inference. Under the widely used StateFarm benchmark, our proposed method presents the best performance.Keywords
Funding Information
- Chinese Academy of Sciences
This publication has 8 references indexed in Scilit:
- CutMix: Regularization Strategy to Train Strong Classifiers With Localizable Features2019
- Deformable Convolutional Networks2017
- Xception: Deep Learning with Depthwise Separable Convolutions2017
- Deep Residual Learning for Image Recognition2016
- Driving posture recognition by convolutional neural networksIET Computer Vision, 2016
- Driving Posture Recognition by Joint Application of Motion History Image and Pyramid Histogram of Oriented GradientsInternational Journal of Vehicular Technology, 2014
- Recognition of driving postures by contourlet transform and random forestsIET Intelligent Transport Systems, 2012
- Classification of Driving Postures by Support Vector Machines2011