Multilevel weather detection based on images: a machine learning approach with histogram of oriented gradient and local binary pattern-based features
- 5 July 2021
- journal article
- research article
- Published by Taylor & Francis in Journal of Intelligent Transportation Systems
- Vol. 25 (5) , 513-532
Abstract
The primary objective of this study was to develop a trajectory-level weather detection system capable of providing real-time weather information at the road surface level using only a single video camera. Two texture-based features, including histogram of oriented gradient (HOG) and local binary pattern (LBP), were extracted from images and used as classification parameters to train the weather detection models using several machine learning classifiers, such as gradient boosting (GB), random forest (RF), and support vector machine (SVM). In addition, a unique multilevel model, based on a hierarchical structure, was also proposed to increase detection accuracy. Evaluation results revealed that the multilevel model provided an overall accuracy of 89.2%, which is 3.2%, 7.5%, and 7.9% higher compared to the SVM, RF, and GB model, respectively, using the HOG features. Considering the LBP features, the multilevel model also produced the best performance with an overall accuracy of 91%, which is 1.6%, 8.6%, and 9% higher compared to the SVM, RF, and GB models, respectively. A sensitivity analysis using the proposed multilevel model revealed that the classification accuracy improved with the increasing number of HOG and LBP features at the expense of more computational powers. The proposed weather detection method is cost-efficient and can be made widely available mainly due to the recent booming of smartphone cameras and can be used to expand and update the current weather-based variable speed limit (VSL) systems in a connected vehicle (CV) environment.Keywords
Funding Information
- the Federal Highway Administration (FHWA) in cooperation with the American Association of State Highway and Transportation Officials (AASHTO) and the Wyoming Department of Transportation (RS07216)
This publication has 40 references indexed in Scilit:
- Detection and Classification of Vehicles by Measurement of Road-Pavement Vibration and by Means of Supervised Machine LearningJournal of Intelligent Transportation Systems, 2015
- Eyes closeness detection from still images with multi-scale histograms of principal oriented gradientsPattern Recognition, 2014
- A Smart Method to Distinguish Road Surface Conditions at Night-time using a Car-Mounted CameraIEEJ Transactions on Electronics, Information and Systems, 2014
- Visibility monitoring using conventional roadside cameras – Emerging applicationsTransportation Research Part C: Emerging Technologies, 2012
- Driver Behavior and Preferences for Changeable Message Signs and Variable Speed Limits in Reduced Visibility ConditionsJournal of Intelligent Transportation Systems, 2012
- Modeling the Effects of Weather and Traffic on the Risk of Secondary IncidentsJournal of Intelligent Transportation Systems, 2012
- Weather Recognition Based on Images Captured by Vision System in Vehicle2009
- Real-Time Disparity Contrast Combination for Onboard Estimation of the Visibility DistanceIEEE Transactions on Intelligent Transportation Systems, 2006
- Comparison of the Performance of Nonparametric and Parametric MANOVA Test Statistics when Assumptions Are ViolatedMethodology, 2005
- Multiresolution gray-scale and rotation invariant texture classification with local binary patternsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002