Detecting phone‐related pedestrian distracted behaviours via a two‐branch convolutional neural network
Authors:
Open Access
- 8 December 2020
- journal article
- research article
- Published by Institution of Engineering and Technology (IET) in IET Intelligent Transport Systems
- Vol. 15 (1) , 147-158
Abstract
The distracted phone‐use behaviours among pedestrians, like Texting , Game Playing and Phone Calls , have caused increasing fatalities and injuries. However, the research of phone‐related distracted behaviour by pedestrians has not been systemically studied. It is desired to improve both the driving and pedestrian safety by automatically discovering the phone‐related pedestrian distracted behaviours. Herein, a new computer vision‐based method is proposed to detect the phone‐related pedestrian distracted behaviours from a view of intelligent and autonomous driving. Specifically, the first end‐to‐end deep learning based Two‐Branch Convolutional Neural Network (CNN) is designed for this task. Taking one synchronised image pair by two front on‐car GoPro cameras as the inputs, the proposed two‐branch CNN will extract features for each camera, fuse the extracted features and perform a robust classification. This method can also be easily extended to video‐based classification by confidence accumulation and voting. A new benchmark dataset of 448 synchronised video pairs of 53,760 images collected on a vehicle is proposed for this research. The experimental results show that using two synchronised cameras obtained better performance than using one single camera. Finally, the proposed method achieved an overall best classification accuracy of 84.3% on the new benchmark when compared to other methods.Keywords
This publication has 31 references indexed in Scilit:
- Exploring walking gait features for the automated recognition of distracted pedestriansIET Intelligent Transport Systems, 2016
- Co-Interest Person Detection from Multiple Wearable Camera Videos2015
- Distracted walking: Examining the extent to pedestrian safety problemsJournal of Traffic and Transportation Engineering (English Edition), 2015
- Fine-Grained Walking Activity Recognition via Driving Recorder Dataset2015
- Going deeper with convolutions2015
- Pedestrian intention recognition using Latent-dynamic Conditional Random Fields2015
- Estimating risk effects of driving distraction: A dynamic errorable car-following modelTransportation Research Part C: Emerging Technologies, 2015
- Impact of social and technological distraction on pedestrian crossing behaviour: an observational studyInjury Prevention, 2012
- WalkSafe2012
- Profiles in Driver Distraction: Effects of Cell Phone Conversations on Younger and Older DriversHuman Factors: The Journal of the Human Factors and Ergonomics Society, 2004