Correlation Between Reaction Time, Multi-Modal Feedback and Take-Over Requests for Level 3 Automated Vehicles
- 31 March 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Haptics
- Vol. 18 (3) , 776-782
Abstract
We are currently experiencing a paradigm shift towards fully automated vehicles (AVs). On the way towards fully AVs, we will experience an increase in numbers of automated vehicles on our roads, requiring the human driver to take back control in situations, which cannot be handled by the vehicle. These human-robot take-over requests (TORs) can lead to safety risks, in particular in scenarios when the driver fails to understand the TOR and, hence, lacks situational awareness (SA). In this paper, the correlation between reaction time, multimodal feedback, informing the human driver of a transition in automation level, and success of transfer of control has been investigated. Nineteen human drivers have participated in experiments in a full-sized driving simulator: First, the driver was engaged in a secondary reading task while the car was in self-driving mode. Then, a TOR indicated to the driver to take back control. Seven different feedback modalities for the TORs have been created consisting of an audio chime, a visual cue or a static mechano-tactile haptic feedback, or a combination of these. The mechano-tactile feedback is hereby given through soft pneumatic actuators embedded into a novel soft robotic driver's seat. After the driver experienced the TOR, they were given seven seconds to regain SA, retake the driving task and react to a road incident ahead. Based on the results, it can be concluded that reaction times below 2.6 seconds and above 6 seconds result in an unsuccessful transfer of control. Additionally, we have found that haptic feedback results in a timely and safe transfer of control within a shorter time frame, when added to currently commercially available auditory and visual feedback.Keywords
Funding Information
- Engineering and Physical Sciences Research Council (EP/R037795/1)
- Engineering and Physical Sciences Research Council (EP/S014039/1)
- UKRI Trustworthy Autonomous System (EP/V00784X/1)
This publication has 20 references indexed in Scilit:
- The effects of takeover request modalities on highly automated car control transitionsAccident Analysis & Prevention, 2019
- Transitioning to manual driving requires additional time after automation deactivationTransportation Research Part F: Traffic Psychology and Behaviour, 2018
- Effects of adaptive cruise control and highly automated driving on workload and situation awareness: A review of the empirical evidenceTransportation Research Part F: Traffic Psychology and Behaviour, 2014
- Driver comprehension of multiple haptic seat alerts intended for use in an integrated collision avoidance systemTransportation Research Part F: Traffic Psychology and Behaviour, 2011
- Haptic Seat Interfaces for Driver Information and Warning SystemsInternational Journal of Human–Computer Interaction, 2011
- Capturing spatial attention with multisensory cues: A reviewHearing Research, 2009
- Coding and use of tactile signals from the fingertips in object manipulation tasksNature Reviews Neuroscience, 2009
- On the null distribution of the Kruskal–Wallis statisticJournal of Nonparametric Statistics, 2003
- Asymptotic Statistics1998
- Use of Ranks in One-Criterion Variance AnalysisJournal of the American Statistical Association, 1952