Helmet Use Detection of Tracked Motorcycles Using CNN-Based Multi-Task Learning
Open Access
- 2 September 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 8, 162073-162084
Abstract
Automated detection of motorcycle helmet use through video surveillance can facilitate efficient education and enforcement campaigns that increase road safety. However, existing detection approaches have a number of shortcomings, such as the inabilities to track individual motorcycles through multiple frames, or to distinguish drivers from passengers in helmet use. Furthermore, datasets used to develop approaches are limited in terms of traffic environments and traffic density variations. In this paper, we propose a CNN-based multi-task learning (MTL) method for identifying and tracking individual motorcycles, and register rider specific helmet use.We further release the HELMET dataset, which includes 91,000 annotated frames of 10,006 individual motorcycles from 12 observation sites in Myanmar. Along with the dataset, we introduce an evaluation metric for helmet use and rider detection accuracy, which can be used as a benchmark for evaluating future detection approaches.We show that the use of MTL for concurrent visual similarity learning and helmet use classification improves the efficiency of our approach compared to earlier studies, allowing a processing speed of more than 8 FPS on consumer hardware, and a weighted average F-measure of 67.3% for detecting the number of riders and helmet use of tracked motorcycles. Our work demonstrates the capability of deep learning as a highly accurate and resource efficient approach to collect critical road safety related data.Keywords
Funding Information
- Deutsche Forschungsgemeinschaft (251654672)
- TRR 161
- University of Otago Research (2019)
This publication has 32 references indexed in Scilit:
- Helmet presence classification with motorcycle detection and trackingIET Intelligent Transport Systems, 2012
- Helmet Use Among Motorcyclists in Cambodia: A Survey of Use, Knowledge, Attitudes, and PracticesTraffic Injury Prevention, 2012
- Prevalence of helmet use among motorcycle riders in VietnamInjury Prevention, 2006
- Dynamic camera calibration of roadside traffic management cameras for vehicle speed estimationIEEE Transactions on Intelligent Transportation Systems, 2003
- Computer vision algorithms for intersection monitoringIEEE Transactions on Intelligent Transportation Systems, 2003
- Detection and classification of vehiclesIEEE Transactions on Intelligent Transportation Systems, 2002
- Mahalanobis distanceResonance, 1999
- A real-time computer vision system for vehicle tracking and traffic surveillanceTransportation Research Part C: Emerging Technologies, 1998
- A New Approach to Linear Filtering and Prediction ProblemsJournal of Basic Engineering, 1960
- Algorithms for the Assignment and Transportation ProblemsJournal of the Society for Industrial and Applied Mathematics, 1957