Deep learning‐based helmet wear analysis of a motorcycle rider for intelligent surveillance system
Authors:
Open Access
- 17 April 2019
- journal article
- research article
- Published by Institution of Engineering and Technology (IET) in IET Intelligent Transport Systems
- Vol. 13 (7) , 1190-1198
Abstract
Automatic helmet wear analysis of a motorcycle rider is a promising video surveillance application, as the helmets are indispensable for saving the lives of humans from head injuries during road accidents. This article presents an intelligent video surveillance system for automatically detecting the motorcyclists with and without safety helmets. If the motorcyclists are found without the helmet, his/her license plate (LP) number is recognised to initiate further actions such as deduction of penalty amount from one's account linked with the vehicle license and Aadhar Number (Applicable to Indian Scenario) by the traffic police and the legal authority. First, the foreground objects are segmented, using Gaussian mixture model (GMM) and then labelled. Afterwards, the proposed system adapts faster region‐based convolutional neural network (faster R‐CNN) for the detection of motorcycles in the labelled foreground objects to ensure the presence of motorcyclists. Subsequently, faster R‐CNN is also used for the detection of the motorcyclists with and without helmet. Finally, the LP number of the motorcyclists without the helmet is recognised, using character‐sequence encoding CNN model and spatial transformer (ST). The proposed framework is evaluated, using the performance metric and mean average precision (mAP) on the surveillance dataset and it outperforms the state‐of‐the‐art algorithms.Keywords
This publication has 35 references indexed in Scilit:
- Region-Based Convolutional Networks for Accurate Object Detection and SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Visual object detection with deformable part modelsCommunications of the ACM, 2013
- Helmet presence classification with motorcycle detection and trackingIET Intelligent Transport Systems, 2012
- A Public Health Perspective of Road Traffic AccidentsJournal of Family Medicine and Primary Care, 2012
- The effects of provincial bicycle helmet legislation on helmet use and bicycle ridership in CanadaInjury Prevention, 2010
- Urban road user detection and classification using 3D wire frame modelsIET Computer Vision, 2010
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009
- Combining shadow detection and simulation for estimation of vehicle size and positionPattern Recognition Letters, 2009
- Bicycle helmet prevalence two years after the introduction of mandatory use legislation for under 18 year olds in Alberta, CanadaInjury Prevention, 2006
- Efficient adaptive density estimation per image pixel for the task of background subtractionPattern Recognition Letters, 2006