Transformer Architectures for Distracted Driving Behavior Detection: A Comprehensive Review of Vision-Based Approaches
Top Cited Papers
Open Access
- 2 January 2026
- journal article
- review article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Open Journal of Intelligent Transportation Systems
- Vol. 7, 233-267
Abstract
Distracted driving is a leading cause of road accidents, with visual and manual distractions being particularly prevalent. Traditional computer vision methods, particularly Convolutional Neural Networks (CNNs), have been extensively utilized for detecting driver behavior; however, they face challenges in effectively modeling long-range dependencies and complex spatiotemporal patterns. Recent advancements in Vision Transformer (ViT) demonstrate significant potential to address these limitations by leveraging global attention mechanisms and a scalable architecture. This review presents a comprehensive review of ViT-based approaches in distracted driving detection, which covers both image-based and video-based methods. It examines several architectural innovations, such as lightweight ViT variants, pose-aware attention-enhanced models, and hybrid ViT-architecture designs. The review also explores multi-modal and multi-view fusion strategies, which integrate several inputs such as RGB, infrared, depth, and physiological signals to enhance model robustness across diverse driving scenarios. In addition, the paper highlights benchmark datasets and performance comparisons used in distracted driving behavior detection. Finally, this review highlights the current challenges, including computational cost and interpretability, while also proposing directions for future research. Overall, ViT-based models present a promising foundation for developing the next generation of intelligent driver monitoring systems.Keywords
Funding Information
- Ministry of Higher Education through the Fundamental Research Grant Scheme (FRGS/1/2023/TK07/UITM/02/23)
This publication has 124 references indexed in Scilit:
- MAViT: A lightweight hybrid model with mutual attention mechanism for driver behavior recognitionEngineering Applications of Artificial Intelligence, 2025
- Improving real-time driver distraction detection via constrained attention mechanismEngineering Applications of Artificial Intelligence, 2023
- Feature selection for driving style and skill clustering using naturalistic driving data and driving behavior questionnaireAccident Analysis & Prevention, 2023
- Multi-scale space-time transformer for driving behavior detectionMultimedia Tools and Applications, 2023
- PVT v2: Improved baselines with pyramid vision transformerComputational Visual Media, 2022
- End-to-End Object Detection with Transformers2020
- DMD: A Large-Scale Multi-modal Driver Monitoring Dataset for Attention and Alertness Analysis2020
- Real-time monitoring of driver drowsiness on mobile platforms using 3D neural networksNeural Computing and Applications, 2019
- Textual Explanations for Self-Driving Vehicles2018
- Temporal Segment Networks: Towards Good Practices for Deep Action Recognition2016