ARISE: Explainable Multimodal Aggressive Driving Detection via Driver State and Environment Perception
- 8 July 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Intelligent Systems
- Vol. 40 (6) , 41-51
Abstract
Detecting aggressive driving is challenging but crucial for public safety. Existing methods rely on time-series data of drivers’ physiology, behavior, and vehicle movement but overlook driver’s emotion and environmental influences. We propose ARISE, a multi-source aggregation model integrating physiological, behavioral, and emotional data, vehicle sensor inputs, and environmental conditions. ARISE employs multi-source feature extraction, multimodal fusion, and a classifier to detect aggressive driving. Unlike graph-based methods that fails to detect gradual aggression shifts or transformer-based methods prone to delays, ARISE explicitly models vehicle state continuity and the aggressive driving environment. Motion similarity descriptor tracks state transitions, while aggression descriptor quantifies environmental aggression. Additionally, driving performance descriptor assesses driving workload and stability. Experiments show that ARISE significantly outperforms state-of-theart methods in aggressive driving detection.Keywords
This publication has 11 references indexed in Scilit:
- TodyNet: Temporal dynamic graph neural network for multivariate time series classificationInformation Sciences, 2024
- EmoTake: Exploring Drivers’ Emotion for Takeover Behavior PredictionIEEE Transactions on Affective Computing, 2024
- Towards Safe Autonomy in Hybrid Traffic: Detecting Unpredictable Abnormal Behaviors of Human Drivers via Information SharingACM Transactions on Cyber-Physical Systems, 2024
- Quantitative stock portfolio optimization by multi-task learning risk and returnInformation Fusion, 2023
- KnowleNet: Knowledge fusion network for multimodal sarcasm detectionInformation Fusion, 2023
- Detecting Socially Abnormal Highway Driving Behaviors via Recurrent Graph Attention Networks2023
- Formulating Vehicle Aggressiveness Towards Social Cognitive Autonomous DrivingIEEE Transactions on Intelligent Vehicles, 2023
- FlowFormer: A Transformer Architecture for Optical Flow2022
- Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingProceedings of the AAAI Conference on Artificial Intelligence, 2021
- A Spontaneous Driver Emotion Facial Expression (DEFE) Dataset for Intelligent Vehicles: Emotions Triggered by Video-Audio Clips in Driving ScenariosIEEE Transactions on Affective Computing, 2021