Naturalistic driving data extraction and processing for studying driver head scanning behavior at intersections
Open Access
- 18 June 2026
- journal article
- Published by Springer Nature in Scientific Reports
- Vol. 16 (1)
Abstract
Naturalistic driving (ND) studies offer key insights about real-world driver behavior compared to lab and on-road studies along a fixed course. We describe an ND data processing pipeline for characterizing the scene and driver behavior at intersections. The in-car recording system recorded the vehicle's speed, location, and videos of the cabin and the front scene. Intersection locations were approximately marked from the drive log, and corresponding cabin and scene videos were clipped for ± 100 m segments around the marked intersection locations. Scene videos were processed to extract intersection scene characteristics including the type of signage, vehicle maneuver, traffic density, and to precisely estimate the vehicle's entry and exit from an intersection. Driver head pose in cabin videos was estimated using a custom-developed AI model for wide angle head turns. Evaluation involved 365 manually-annotated intersection instances from 6 vehicles driven in 3 US states. Signage and maneuvers were correctly detected in 99% and 95% of cases, respectively. Median[IQR] intersection entry error was 1.1[0.3-4.2] meters, 0.23 [0.07-0.63] seconds; overlap between estimated and ground truth intersection bounds was 0.88[0.8-0.94]. There was strong positive correlation between estimated and annotated traffic density (R = 0.73, p < 0.001). Head pose estimation over a range of ± 135° had a mean absolute error of 6.75 ± 5.0° and an RMSE of 8.4°. Our approach can potentially allow automated processing of a vast amount of ND data while enabling the study of specific driver behaviors that were previously not achieved.Keywords
Funding Information
- National Eye Institute (R01-EY025677)
This publication has 47 references indexed in Scilit:
- Naturalistic Driving Techniques and Association of Visual Risk Factors With At-Fault Crashes and Near Crashes by Older Drivers With Vision ImpairmentJAMA Ophthalmology, 2021
- Analyzing driver behavior under naturalistic driving conditions: A reviewAccident Analysis & Prevention, 2021
- Naturalistic Driving Studies: An Overview and International Perspective2021
- Older driver fitness-to-drive evaluation using naturalistic driving dataJournal of Safety Research, 2015
- A roadmap for interpreting the literature on vision and drivingSurvey of Ophthalmology, 2015
- Compensatory eye and head movements of patients with homonymous hemianopia in the naturalistic setting of a driving simulationJournal of Neurology, 2014
- Distracted Driving and Risk of Road Crashes among Novice and Experienced DriversNew England Journal of Medicine, 2014
- Microsoft COCO: Common Objects in Context2014
- Gaze patterns predicting successful collision avoidance in patients with homonymous visual field defectsVision Research, 2012
- The 100-Car Naturalistic Driving Study: Phase II - Results of the 100-Car Field Experiment2006